Jupyter notebooks in CI
- Keep notebook as .md or .py file with jupytext.
- On CI execute directly with jupytext or convert to .ipynb and then run with nbconvert.
- With nbconvert convert to HTML, extract images, maybe diff images to reference images. Save these CI artifacts.
Some more tools:
- treon (test framework)
- nbstripout (strips out output cells on commit)
- nbdime (diffing and merging)
- ploomber (execute a graph of notebooks), similar to Snakemake but specifically for notebooks, I guess Snakemake does the same but even more powerful
cc: @endJunction, @chleh