Smart District Data Infrastructure (SDDI) enabled Docker images for CKAN

Report Bug · Request Feature

This repository provides CKAN Docker images for the sddi-ckan-k8s Helm chart. The images contain CKAN itself compiled with a set of CKAN extension to add functionality required for the SDDI concept and beyond that. All images are available form ghcr.io/tum-gis Github container registry. See packages for all image flavors and tags.

• 📖 Table of content
• 📥 Image flavor overview
  • sddi-base
  • sddi
  • sddi-social
• 🔢 Image versioning
  • Development image versions
  • CKAN and CKAN extension versions
• 🚀 Usage
• 📖 Configuration an documentation
• 🛠️ Contributing
  • Contributors
    • Github contributors to this repo
• 🎓 Research
  • Publications
  • Cite this repository
• 🤝 Thanks
• 📝 License

The CKAN-SDDI Docker images are released in three flavors, that are described below. For each flavor a one package exists in this repository, where the image can be pulled.

docker pull ghcr.io/tum-gis/ckan-sddi-base
docker pull ghcr.io/tum-gis/ckan-sddi
docker pull ghcr.io/tum-gis/ckan-sddi-social

CKAN base image with a minimal set of extensions required for SDDI. Default SDDI groups and topics are preinstalled. This image is used as base image for the other images. If you plan to extend the SDDI images, use this as base image.

ghcr.io/tum-gis/ckan-sddi-base

sddi-base + commonly used CKAN extensions for e.g. extended data format and preview support. This is the image most people will usually want.

ghcr.io/tum-gis/ckan-sddi

sddi + optional CKAN extension for social media features, that may require staff for moderation of social media content.

ghcr.io/tum-gis/ckan-sddi-social

The images in this repo are versioned and tagged according to the releases of this repository. The latest tag points to the latest release number. The edge version is built from the latest commit to the main branch of this repo.

All available tags are listed in the packages of each image:

• sddi-base
• sddi
• sddi-social

For development purposes the devel images, which are build from the latest commit to the devel branch are published. The devel images are used for testing and may contain errors. The CKAN and CKAN extension versions used for each image are listed in the table below.

For debugging we provide a debug version for each image version. These images are indicated by the -debug suffix on the image tag, e.g. latest-debug, 0.0.6-debug, edge-debug or devel-debug. The debug images have the FLASK debug toolbar enabled and all required debugging dependencies installed. Read more on CKAN's debug mode in the official docs. Debug images are available starting from v0.0.6.

Warning: The debug image versions should not be used in a production environment! With debug mode enabled, a visitor to your site could execute malicious commands.

Furthermore, for each commit to a Pull request all image flavors are build. These images are published in the ckan-sddi-dev package. Images are named following this pattern:

ghcr.io/tum-gis/ckan-sddi-dev:<IMAGE FLAVOR>-pr-<PR NUMBER>-[-debug] ghcr.io/tum-gis/ckan-sddi-dev:<IMAGE FLAVOR>-pr-<PR NUMBER>-<SHORT-SHA>[-debug]

The image without the SHORT-SHA refer to the latest build of a pull request.

For instance, for commit 19a2e64 to PR #26 following images are build:

• ghcr.io/tum-gis/ckan-sddi-dev:sddi-base-pr-26
• ghcr.io/tum-gis/ckan-sddi-dev:sddi-base-pr-26-debug
• ghcr.io/tum-gis/ckan-sddi-dev:sddi-base-pr-26-19a2e64
• ghcr.io/tum-gis/ckan-sddi-dev:sddi-base-pr-26-19a2e64-debug
• ghcr.io/tum-gis/ckan-sddi-dev:sddi-pr-26
• ghcr.io/tum-gis/ckan-sddi-dev:sddi-pr-26-debug
• ghcr.io/tum-gis/ckan-sddi-dev:sddi-pr-26-19a2e64
• ghcr.io/tum-gis/ckan-sddi-dev:sddi-pr-26-19a2e64-debug
• ghcr.io/tum-gis/ckan-sddi-dev:sddi-social-pr-26
• ghcr.io/tum-gis/ckan-sddi-dev:sddi-social-pr-26-debug
• ghcr.io/tum-gis/ckan-sddi-dev:sddi-social-pr-26-19a2e64
• ghcr.io/tum-gis/ckan-sddi-dev:sddi-social-pr-26-19a2e64-debug

This registry will be cleared periodically.

CKAN version: 2.9.9 CKAN base image: ghcr.io/keitaroinc/ckan:2.9.9-focal

The CKAN catalog platform uses several extensions to provide the functionality needed for the SDDI concept. The table below lists the included extensions with the currently used version. Depending of the version of the upstream repository of the individual extensions, the version refers either to a release version or commit hash.

To ensure stable versioning for the images, the versions in the Dockerfiles are alway pinned to a stable release number or commit hash.

Note: Version pinning is only applied for release versions. The edge image may depend on upstream branches instead.

The images provided in this repo are designed for the sddi-ckan-k8s Helm chart. Go to the Helm chart repository to find examples an how to run the images.

The configuration of the Docker images is mainly done using environment variables using the naming convention of ckanext-envvars. Refer to the documentation of ckan and the extensions listed below to find the available configuration options.

Bug fixes, issue reports and contributions are greatly appreciated.

Marija Knezevic and Bruno Willenborg at Technical University of Munich, Chair of Geoinformatics realized the current SDDI CKAN Docker images and Helm chart and updated the CKAN SDDI extensions (ckanext-grouphierarchy, ckanext-relation) initially implemented by Mandana Moshrefzadeh and Wolfgang Deigele.

The core concepts, documentation, and initial implementation for SDDI were realized at Technical University of Munich, Chair of Geoinformatics by:

• Mandana Moshrefzadeh: Landeshauptstadt München, Kommunalreferat – GeodatenService
• Prof. Thomas H. Kolbe: Technical University of Munich, Chair of Geoinformatics
• Dr. Andreas Donaubauer: Technical University of Munich, Chair of Geoinformatics
• Marija Knezevic: Technical University of Munich, Chair of Geoinformatics
• Bruno Willenborg: Technical University of Munich, Chair of Geoinformatics
• Kanishk Chaturvedi, Software AG
• Son H. Nguyen, Technical University of Munich, Chair of Geoinformatics
• Wolfgang Deigele, ESRI Deutschland

An overview of the Smart District Data Infrastructure (SDDI) Project is available at the Chair of Geoinformatics, Technical University of Munich homepage in english and german.

The full list of SDDI related publications is available here. Some key publications are listed below:

• Knezevic et al. (2022): Managing Urban Digital Twins with an Extended Catalog Service, Proceedings of the 7th International Smart Data and Smart Cities (SDSC) Conference 2022, ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences, PDF download / DOI.

• Deigele, W. et al. (2021): Leitfaden – Geobasierter Digitaler Zwilling nach der SDDI-Methode, Ed.: Bayern Innovativ, ZD.B – Themenplattform Smart Cities and Regions.

• Gackstetter, D. et al. (2021): Smart Rural Areas Data Infrastructure (SRADI) – an information logistics framework for digital agriculture based on open standards, 41. GIL-Jahrestagung 2021 - Fokus: Informations- und Kommunikationstechnologie in kritischen Zeiten, Gesellschaft für Informatik e.V. (GI), PDF download / DOI.

• Kolbe, T. H. et al. (2020): The Data Integration Challenge in Smart City Projects, Chair of Geoinformatics, Technical University of Munich, PDF download / DOI.

• Moshrefzadeh, M. et al. (2020): Towards a Distributed Digital Twin of the Agricultural Landscape, Journal of Digital Landscape Architecture (5), PDF download / DOI.

• Moshrefzadeh, M. et al. (2017): Integrating and Managing the Information for Smart Sustainable Districts - The Smart District Data Infrastructure (SDDI), In: Kolbe, Thomas H.; Bill, Ralf; Donaubauer, Andreas (Hrsg.): Geoinformationssysteme 2017 – Beiträge zur 4. Münchner GI-Runde. . Wichmann Verlag, PDF download / DOI.

• Moshrefzadeh, M. and T.H. Kolbe (2016): Smart Data Infrastructure for Smart and Sustainable Cities, DDSS 2016, PDF download / DOI.

To cite this repository, please use the DOI provided by Zenodo. If you want to reference a specific release version of the software, click the badge and navigate to the desired version on the page.

We would like to thank following institutions and persons for their contributions to the SDDI concepts, tools, documentations, education, and funding:

• ZD.B-Themenplattform Smart Cities and Regions: Willi Steincke at Bayern Innovativ GmbH und Lutz Morich, for funding and supporting the SDDI development for several years.

• Bayerisches Staatsministerium für Digitales for funding the project TwinBy and Stefan Bobinger for many contributions to SDDI concepts and documentation.

• Digital Twin Munich / Digitaler Zwilling München, Connected Urban Twins (CUT) research project, SAVeNoW research project, eit Climate-KIC (SDDI research project) for funding the work on SDDI concepts and implementation.

• Tome Petrovski 🙌 for professional support with CKAN and CKAN extension development.

• KEITARO for their CKAN Docker images and CKAN Helm chart that inspired this work.

This Helm chart is distributed under the Apache License 2.0. See LICENSE for more information.