The current documentation has you bounce back and forth between the cmdline and the UI.

The instructions will look like:

# pull UPGRADE_VERSION from github
docker-compose down
docker-compose up -d db server webapp
curl --data "{}" http://localhost:8001/api/v1/deployment/export > export.tar.gz
docker run --rm -v $(pwd):/config airbyte/migration:$UPGRADE_VERSION -- --input /config/export.tar.g

Problem

At present jitsucom/server supports API connectors (sources) sync only into ClickHouse and Postgres. Because it uses upsert statements. We should support all Data warehouses:

• ClickHouse
• Postgres
• BigQuery
• Snowflake
• Redshift

Solution

• for transactional DB (Postgres, Redshift, Snowflake): jitsucom/server should use delete (by chunk) + insert in one transaction

Complete algorithm: http://web.cecs.pdx.edu/~mpj/pubs/polyrec.html

The tags belonging to one of the high-level categories can be further clustered into subcategories. These can then be used as filters in queries (see #16).

The example structure based on kuwala-pipelines/osm-poi/resources/categories.json would look like this (naming for subcategories: highLevelCategory_subcategory):

{
  "sport": {
    "category": "sport",
    "tags": [