Python Stack in Amsterdam Modeling Suite¶
General¶
The Amsterdam Modeling Suite includes a python stack based on the Enthought Python Distribution.
AMS version |
Python version |
---|---|
AMS2024 |
3.8.12 |
AMS2023 |
3.8.12 |
AMS2022 |
3.6.9 |
AMS2021 |
3.6.9 |
AMS2020 |
3.6.9 |
This python stack is completely separate from any other python installations on the system.
All programs within the Amsterdam Modeling Suite launch python via a special command, amspython
.
Included modules¶
Some of the included modules are:
numpy (1.21.2) and scipy (1.8.0): Big modules with a lot of functionality for math and science, more information on the SciPy website.
IPython (7.22.0): An improved interactive python shell, more information can be found on the iPython website. Can be started with:
$AMSBIN/amsipython
ase (3.22.1): ASE (Atomic Simulation Environment) is a python module for atomistic simulations, more information in the ASE documentation.
matplotlib (3.5.1): A library for plotting data in 2D, more information on the Matplotlib website. We do not ship an interactive backend for matplotlib, so make sure to set a non-interactive backend when using it. For example the Agg backend for PNGs:
import matplotlib matplotlib.use('Agg')
pip (21.3.1): The recommended tool for installing packages from the Python Package Index (PyPI). The pip documentation explains in detail how to use this tool, but for the Python stack shipped with the Amsterdam Modeling Suite all pip commands need to be prefixed with $AMSBIN/amspython -m:
$AMSBIN/amspython -m pip list $AMSBIN/amspython -m pip show scipy $AMSBIN/amspython -m pip search rotate-backups $AMSBIN/amspython -m pip install rotate-backups
flexmd: A module for running MD simulations with adaptive QM/MM regions. Details can be found in the FlexMD documentation.
plams: PLAMS (Python Library for Automating Molecular Simulation) is a collection of tools that aim at providing powerful, flexible and easily extendable Python interface to molecular modeling programs. It takes care of input preparation, job execution, file management and output processing as well as helps with building more advanced data workflows. See the PLAMS tutorials and PLAMS documentation for more information.
autografs: AuToGraFS stands for Automatic Topological Generator for Framework Structures. Information and examples can be found in the AuToGraFS documentation.
Using other modules with the AMS Python Stack¶
You can extend the the AMS Python Stack with other modules. You can use pip (see above) to install additional modules if they are available on the Python Package Index (PyPI). This is the recommended way of installing packages:
$AMSBIN/amspython -m pip install name_of_package
You can also do this for your own packages that you develop, for example:
$AMSBIN/amspython -m pip install -e .
Alternatively, you can add the location of the source to the SCM_PYTHONPATH
variable to make the module available in the AMS Python Stack. To avoid collisions with other python installations on the system, we unload PYTHONPATH
and PYTHONHOME
from the environment when launching the ADF Python Stack and put the content of SCM_PYTHONPATH
into PYTHONPATH
.
Hint
If you for some reason have to use the PYTHONPATH variable and are unable to use SCM_PYTHONPATH, you can modify $AMSBIN/amspython and $AMSBIN/amsipython to not have it cleared when starting python.
Install and run Jupyter Lab (Jupyter Notebooks)¶
Install Jupyter Lab¶
AMS2023 or later: Install Jupyter lab in the Package Manager (GUI: SCM → Packages, Command-line: $AMSBIN/amspackages gui
or $AMSBIN/amspackages -h
).
Run Jupyter Lab¶
In a command-line, run:
"$AMSBIN/amspython" -m jupyterlab
This will open up Jupyter Lab in your web browser.
To create a new notebook, click the blue plus (+) button at the top left and select Notebook → Python 3 (ipykernel).
Execute a notebook from the command-line¶
If you want to run a Jupyter notebook from the command-line, for example when submitting to a cluster, you can do something like the following
cat > template.tpl <<EOF
{%- block body %}
{{ nb | json_dumps }}
{% endblock body %}
EOF
"$AMSBIN/amspython" \
-m nbconvert \
--to custom \
--template template.tpl \
--RegexRemovePreprocessor.patterns='^!' \
--execute \
--output output.ipynb \
notebook.ipynb
Above, the purpose of template.tpl
is to allow the use of the
RegexRemovePreprocessor
. It will exclude cells starting with an exclamation
mark !
, for example commands used to launch GUI modules like AMSmovie or
AMSspectra.
Python virtual environment¶
Default python virtual environment¶
Starting with AMS2020, the amspython
command by default checks for a python virtual environment inside the user’s home directory. If it does not find a virtual environment, it will create one in the following location (these are the default values for the SCM_PYTHONDIR
environment variable):
Windows:
$USERPROFILE/.scm/python
Mac:
$HOME/Library/Application Support/SCM/python
Linux:
$HOME/.scm/python
amspython
then launches the python binary located inside the virtual environment.
If you install additional packages via pip (see above), they will be installed into the virtual
environment’s site-packages
.
Virtual environments for different AMS versions¶
The virtual environment is tied to the major release version of AMS, which is reflected in the name of the virtual environment directory (e.g. AMS2020.1.venv).
Thus, upgrading from AMS2020.101 to AMS2020.102 will automatically let you use all python packages that you installed into the AMS2020.101 virtual environment.
To use previously installed python packages when upgrading from AMS2020.101 to e.g. AMS2020.301 or AMS2021.101, simply copy or rename AMS2020.1.venv to AMS2020.3.venv or AMS2021.1.venv in the same directory.
If you have several installations of different major releases of the Amsterdam Modeling Suite on the same computer, multiple virtual environments will also be created, one for each installation.
Changing the location of the python virtual environment¶
Set the SCM_PYTHONDIR
environment variable to a directory in which the
virtual environment will be installed. If you use the graphical user interface
(GUI), this environment variable can be changed in the GUI preferences. If you
use the command line, set it in your amsbashrc.sh
. If you use both the GUI
and the command line, you should change it in both places.
Disabling the virtual environment¶
Follow the steps for changing the location of the python virtual environment, but set SCM_PYTHONDIR
to be empty.
Uninstalling the virtual environment¶
Just delete the directory containing the virtual environment. This will also delete any packages that you have installed into it.
Reinstalling the virtual environment¶
To force a reinstallation of the virtual environment, even if it already
exists, run $AMSBIN/amspython --install_venv
. This will not remove any
packages inside the virtual environment.
Useful commands¶
Start a python shell:
$AMSBIN/amspython
Install new packages via pip:
$AMSBIN/amspython -m pip install name_of_package
Find out the location of an installed package (e.g. numpy):
$AMSBIN/amspython -c 'import numpy; print(numpy.__file__)'
Find out which python binary is launched by amspython:
$AMSBIN/amspython -c 'import sys; print(sys.executable)'
Disable the virtual environment (one-time):
SCM_PYTHONDIR='' $AMSBIN/amspython