Compatibility Matrix¶

#!/bin/bash

# Purpose: Get all important versions from the build Carto-Lab Docker Container
# to be listed in the compatibility matrix
# https://cartolab.fdz.ioer.info/matrix/

# Utility function to get Python package version
get_python_version() {
  local env=$1
  local pkg=$2

  # Special handling for jupyter-collaboration
  if [[ "$pkg" == "jupyter-collaboration" ]]; then
    docker compose run jupyterlab /opt/conda/envs/${env}/bin/python -c \
      "from importlib.metadata import version; print(version('${pkg}'))" 2>/dev/null
  else
    docker compose run jupyterlab /opt/conda/envs/${env}/bin/python -c \
      "import ${pkg}; print(${pkg}.__version__)" 2>/dev/null
  fi
}


printf "\nJupyter env package versions: \n\n"
jupyter_packages=(
  "notebook"
  "IPython"
  "jupyterlab_git"
  "jupyterlab_lsp"
  "pyright"
  "jupytext"
  "jupyterlab_widgets"
  "nbconvert"
  "nbclassic"
  "papermill"
  "jupyterlab_spellchecker"
  "jupyter_contrib_nbextensions"
  "jupyter-collaboration"
  "jupytergis"
)

for pkg in "${jupyter_packages[@]}"; do
  version=$(get_python_version jupyter_env $pkg)
  echo "$pkg ${version:-Not Installed}"
done

printf "\nWorker env package versions: \n\n"
worker_packages=(
  "geopandas"
  "ipywidgets"
  "matplotlib"
  "shapely"
  "pyproj"
  "pandas"
  "numpy"
  "cartopy"
  "geoviews"
  "bokeh"
  "rasterio"
  "rioxarray"
)

for pkg in "${worker_packages[@]}"; do
  version=$(get_python_version worker_env $pkg)
  echo "$pkg ${version:-Not Installed}"
done

printf "\nGDAL: \n\n"
docker compose run jupyterlab /bin/bash -c "/opt/conda/envs/worker_env/bin/gdalinfo --version"

printf "\nOS: \n\n"
docker compose run jupyterlab /bin/bash -c "cat /etc/*release"

printf "\njupyterlab Python \n\n"
docker compose run -e JUPYTER_PLATFORM_DIRS=1 jupyterlab \
  /opt/conda/envs/jupyter_env/bin/python -W ignore::DeprecationWarning -c "import jupyterlab; print(jupyterlab.__version__)"

printf "\njupyter_server \n\n"
docker compose run jupyterlab /opt/conda/envs/jupyter_env/bin/python -c "import jupyter_server; print(jupyter_server.__version__)"

printf "\nworker_env Python \n\n"
docker compose run jupyterlab /opt/conda/envs/worker_env/bin/python --version

printf "\njupyter_env Python \n\n"
docker compose run jupyterlab /opt/conda/envs/jupyter_env/bin/python --version

printf "\nMapnik (requires container tag :mapnik) \n\n"
docker compose run jupyterlab /usr/bin/python3 -c "import mapnik;print(mapnik.paths.__all__)"
# echo "\nR Version (requires container tag :r) \n\n"
# docker compose run jupyterlab ls /opt/conda/envs/r_env/bin/

printf "\nConda version: \n\n"
docker compose run jupyterlab conda --version

printf "\nR Version (requires container tag :r) \n\n"
docker compose run jupyterlab conda run -n r_env Rscript -e 'cat(R.version.string, "\n")'

printf "\nnodejs version \n\n"
# docker compose run jupyterlab bash -c "conda init;conda activate jupyter_env; nodejs"
docker compose run jupyterlab conda run --no-capture-output -n jupyter_env node --version

### R tag ###

printf "\n=========================================\n"
printf "R Environment (r_env) checks:\n"
printf "=========================================\n"

# Gracefully check if the r_env environment directory exists
if docker compose run jupyterlab [ -d "/opt/conda/envs/r_env" ]; then

  printf "\nR Version: \n\n"
  docker compose run jupyterlab conda run -n r_env Rscript -e 'cat(R.version.string, "\n")'

  # List of explicitly installed packages to extract
  r_packages=(
    "r-base"
    "r-caret"
    "r-crayon"
    "r-dplyr"
    "r-devtools"
    "r-e1071"
    "r-forecast"
    "r-ggplot2"
    "r-hexbin"
    "r-htmltools"
    "r-htmlwidgets"
    "r-irkernel"
    "r-maps"
    "r-mapdata"
    "r-tmap"
    "r-nycflights13"
    "r-randomforest"
    "r-raster"
    "r-rastervis"
    "r-rcurl"
    "r-rcolorbrewer"
    "r-remotes"
    "r-reshape"
    "r-rmarkdown"
    "r-rodbc"
    "r-rsqlite"
    "r-scales"
    "r-sf"
    "r-stringr"
    "r-shiny"
    "r-terra"
    "r-tidymodels"
    "r-tidyverse"
    "unixodbc"
  )

  # Join array elements with | and wrap each in ^...$ for exact matching
  r_pattern=$(printf "|^%s$" "${r_packages[@]}")
  r_pattern=${r_pattern:1} # Remove the leading "|"

  printf "\nInstalled R Packages: \n\n"
  # Query conda list once with the exact regex pattern
  docker compose run jupyterlab conda list -n r_env "$r_pattern"

else
  printf "\nr_env is not installed (skipping R checks).\n"
fi

COMPOSE_FILE=docker-compose.build.yml

I have a Matrix version table in my doc:

| ▼Feature or Package - Carto-Lab Docker Version ▶ | 0.26.0    | 0.27.1    |             |              |
| ------------------------------------------------ | --------- | --------- | ----------- | ------------ |
| Container OS                                     | Debian 11 |            |             |               |
| Conda                                            | 23.3.1    |            |             |               |
| Jupyter Lab                                      | 3.6.3     |            |             |               |
| Jupyter Server                                   | 2.5.0     |            |             |               |
| Python (Server)                                  | 3.10.10   |            |             |               |
| Python (worker_env)                              | 3.9.15    |            |             |               |
| notebook                                         | 6.5.3     |            |             |               |
| IPython                                          | 8.12.0    |            |             |               |
| nodejs                                           | /         |            |             |               |
| Language Server: jupyterlab-lsp                  | /         |            |             |               |
| Language Server:  pyright                        | /         |            |             |               |
| Jupyter Real Time collaboration (RTC)            | /         |            |             |               |
| jupyterlab_widgets                               | 3.0.7     |            |             |               |
| Jupytext                                         | 1.14.5    |            |             |               |
| Jupyterlab-git                                   |           |            |             |               |
| Spellchecker                                     | 0.7.3     |            |             |               |
| nbextensions                                     | 0.7.0     |            |             |               |
| R                                                | /         |            |             |               |
| Mapnik                                           | 3.1       |            |             |               |
| nbconvert                                        | 7.2.10    |            |             |               |
| papermill                                        | 2.3.4     |            |             |               |
| geopandas                                        | 0.12.2    |            |             |               |
| ipywidgets                                       | 8.0.6     |            |             |               |
| matplotlib                                       | 3.7.1     |            |             |               |
| shapely                                          | 1.7.1     |            |             |               |
| pyproj                                           | 3.2.1     |            |             |               |
| pandas                                           | 1.5.3     |            |             |               |
| numpy                                            | 1.22.4    |            |             |               |
| cartopy                                          | 0.20.1    |            |             |               |
| geoviews                                         | 1.9.5     |            |             |               |
| Bokeh                                            | 2.4.3     |            |             |               |
| Rasterio                                         | 1.2.10    |            |             |               |

I extracted versions for 0.27.1, please use these versions to update the table above:

\```
# paste output from get_versions.sh here
\```