Meta

• License: GPLv3+
• Author: Francesco Murdaca
• Tags Jupyter , JupyterLab
• Requires: Python >=3.8

Classifiers

• Framework
  • IPython
  • Jupyter
• Natural Language
  • English
• Operating System
  • OS Independent
• Programming Language
  • Python
  • Python :: 3
  • Python :: 3.8

jupyterlab-requirements

Dependency management and optimization in JupyterLab.

About

This extension provides management of dependencies for JupyterLab notebooks.

The main goals of the project are the following:

• manage notebook requirements without leaving the notebook
• provide a unique and optimized* environment for each notebook

NOTE: The requirements are optimized using the Thoth resolution engine

Requirements

• JupyterLab >= 3.0

Installation

You can install this extension with pip:

pipinstalljupyterlab-requirements

And start using it immediately on JupyterLab:

jupyterlab

Troubleshoot

If you are seeing the frontend extension, but it is not working, check that the server extension is enabled:

jupyterserverextensionlist

If the server extension is installed and enabled, but you are not seeing the frontend extension, check the frontend extension is installed:

jupyterlabextensionlist

Usage

jupyter-nbrequirements extension for JupyterLab can be easily used from the notebook in JupyterLab.

Extension Button

This jupyterlab extension provides a button directly in the notebook to manage the dependencies (see image below).

Start adding dependencies from empty notebook

Clicking the above button you will receive the following dialog form initially:

Initially, no dependencies are identified if you start a new notebook as metadata related are not existing. The extension checks in the notebook metadata in order to identify them every time you restart a notebook. Moreover it verifies that the kernel you are using is matching your dependencies. If not it warns to use install button again to avoid weird behaviours.

You can start adding your packages using the central add button and once you select package name and version, remember to add your package using add button in action, otherwise it won't be saved (in the future this behaviour will not be necessary due to the autocompletion feature):

NOTE: The extra button in action will be removed in the future.

NOTE: Autocompletion is planned in the future so that user can check which version are available on PyPI.

Save dependencies added and install them in your customized kernel

After saving the install button will appear so you can check before actually installing the dependencies:

NOTE: You can choose the name of the kernel you want for your notebook.

Using the Thoth resolution engine you can request an optimized software that satisfies your requirements using the Thoth recommender system. You can choose the type of recommendation that better fits your needs:

• latest
• performance
• security
• stable
• testing

You can find more information and updates here.

Finally after using the install button:

Now all dependencies will be locked (direct and transitive), saved in the notebook metadata, and installed. Moreover, the kernel will be automatically created and set for your notebook without human intervention required.

Now you are ready to work on your project!

Restart notebook

If you restart notebook and check dependencies with button you will see that they are all installed and ready:

Start notebook without information about dependencies in metadata

If you have notebooks with code and you want to start using this extension, there is a nice feature that can be interesting.

Thoth relies on a library called invectio. This library statically analyzes sources and extract information about called or exported library functions in Python applications.

jupyterlab-requirements extension uses this information to provide users with list of packages to be installed if they have never used the extension before.

Resolution engines

• Thoth

• pipenv

Currently Thoth is used by default and pipenv is backup. In the future user will be able to select specific one.

Virtual environment for you dependencies

Virtualenv created to run your notebook according to your dependencies requirement is created in:

~/.local/share/thoth/kernels/{kernel_name}

Dependencies installation

Once lock file is created using any of available resolution engine. The dependencies are installed in the virtualenv using micropipenv.

Overlays directory

The dependencies stored in the notebook metadata are also stored into overlays folder (created automatically) using the kernel name by default. If you want to know more about the use of overlays, have a look here.

Thoth configuration file

Thoth resolution engine is able to provide an optimized software stack based on the runtime environment you are using (more inputs are used, if you want to know more, have a look here here).

In general different runtime environment will provide different effect on you application (e.g. more performance), therefore we include these information in the notebook metadata so that other can find out what runtime environment has been used to run a certain notebook.

Contributing

Development install

Note: You will need NodeJS to build the extension package.

The jlpm command is JupyterLab's pinned version of yarn that is installed with JupyterLab. You may use yarn or npm in lieu of jlpm below.

# Clone the repo to your local environment
# Change directory to the jupyterlab-requirements directory
# Install package in development mode
pipinstall-ve.
# Link your development version of the extension with JupyterLab
jupyterlabextensiondevelop.--overwrite

jupyterserverextensionenable--pyjupyterlab-requirements--sys-prefix
# Rebuild extension Typescript source after making changes
jlpmrunbuild

You can watch the source directory and run JupyterLab at the same time in different terminals to watch for changes in the extension's source and automatically rebuild the extension.

# Watch the source directory in one terminal, automatically rebuilding when needed
jlpmrunwatch
# Run JupyterLab in another terminal
jupyterlab

With the watch command running, every saved change will immediately be built locally and available in your running JupyterLab. Refresh JupyterLab to load the change in your browser (you may need to wait several seconds for the extension to be rebuilt).

By default, the jlpm run build command generates the source maps for this extension to make it easier to debug using the browser dev tools. To also generate source maps for the JupyterLab core extensions, you can run the following command:

jupyterlabbuild--minimize=False

Uninstall

pipuninstalljupyterlab-requirements

Demo development status and new features

• v0.5.0 [Mar 15 2021]

• v0.3.7 [Feb 10 2021]

• v0.1.0 [Dec 8 2020]

Verified details

These details have been verified by PyPI

Maintainers

👁 Avatar for fmurdaca from gravatar.com
fmurdaca 👁 Avatar for fridex from gravatar.com
fridex 👁 Avatar for goern from gravatar.com
goern 👁 Avatar for sesheta from gravatar.com
sesheta

Unverified details

These details have not been verified by PyPI

Project links

• Homepage

• Download URL: jupyterlab_requirements-0.6.4.tar.gz
• Upload date: Apr 14, 2021
• Size: 96.6 kB
• Tags: Source
• Uploaded using Trusted Publishing? No
• Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.54.1 CPython/3.8.7

Hashes for jupyterlab_requirements-0.6.4.tar.gz

Algorithm	Hash digest
SHA256	2add76f1bdad863b09b8cb4816f14f24f6b245f6b688f5076a839a766a8f778d
MD5	ac3334229607dcc8941bc57aa2da502b
BLAKE2b-256	8a09bcd46099b88096c38bba465e2840a4d6adcc5e4e22bfef52059d5ac2ec3d

See more details on using hashes here.

• Download URL: jupyterlab_requirements-0.6.4-py3-none-any.whl
• Upload date: Apr 14, 2021
• Size: 328.8 kB
• Tags: Python 3
• Uploaded using Trusted Publishing? No
• Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.54.1 CPython/3.8.7

Hashes for jupyterlab_requirements-0.6.4-py3-none-any.whl

Algorithm	Hash digest
SHA256	728002c8a906187260728967555cbf3f86c4e2ff469922a85241140e30d5c2d4
MD5	0a04cb08779ffbe4535370c282d8678e
BLAKE2b-256	3a3037a1e0d729b37edc354cdd8408702ab15e9142044d8d070ee39801c11264

See more details on using hashes here.