Consolidated import-data image, many tool improvements

download-osm

Many improvements and bug fixes like state file support and stats generation - @nyurik

• support for Geofabrik list and state files (#163)
• Support for OSM download metadata (#168) - Similar to docker/import-osm/download-geofabrik.sh script, uses osmconvert tool to extract file statistics, and generate a docker-compose config file with those values.
• supports --make-dc parameter to generate the dc stats file (#168)
• Support docker compose versions in download-osm (#184)
• Handle broken .md5 files in planet download (#211)
• Get proper Geofabrik catalog instead of scraping (#171)

import-wikidata

Several changes (#191) by @nyurik, @TomPohys

• BREAKING wd_names table no longer has pages column, and the id column is now a primary key
• import-wikidata will always re-create the wd_names table
• language.sql will create the wd_names table only if it's missing
• wikidata is cached in a local file

debug-mvt

• allow tile to be specified as z,x,y, handle SQL errors (#206) - @nyurik

natural-earth data

• Explicitly list natural earth tables to include (#190)

import-borders

borders (#191 by @nyurik, @TomPohys) can now be cached in a local file, generated from the downloaded PBF.

• import-borders - Parse and import first PBF file in IMPORT_DIR
• import-borders [import] planet.pbf - Parse and import planet.pbf
• import-borders parse planet.pbf - Parse planet.pbf into a CSV file, but do not import
• import-borders load borders.csv - Load borders.csv into a table

Other

• BREAKING pgfutter is no longer packaged in the tools because \copy in psql works similarly.
• A lot of new tests for SQL and Python
• mbtiles-tools bug to handle empty metadata - @nyurik

New import-data docker image

Added a new import-data image that combines import-lakelines, import-natural-earth, and import-water, which will be removed in the next release. (#187) - @nyurik

New postgis-preloaded image

This is a Docker image that has been pre-loaded with lakelines, natural-earth, and water data.
This image can be used for quicker testing, but might be less suited for a production environment.
The image contains a PostgreSQL database openmaptiles, user=openmaptiles, password=openmaptiles
(#186) - @nyurik

Environment variable changes

Minor docker var improvements (#185) - @nyurik

• lakelines, natural-earth, and water docker images now support PGCONN env var to be passed in.
• added minor postgis output when initializing databases
• when importing water, ensure PGCLIENTENCODING=UTF8 is set

Imposm tags

• Fix imposm tags handling bug (#179), allowing different layers to include additional tags (rather than overriding it, thus the last layer wins) - (#181) @frodrigo, @nyurik

PostGIS 2.4.8 / GEOS 3.6

• Upgrade to PostGIS 2.4.8/GEOS 3.6.4 to fix auto-analyze errors (#166) - @amatissart, @nyurik

etldoc cleanup

• Make graphs cleaner by removing duplicate lines between the same nodes (#164) - @nyurik