Python installation: Difference between revisions
Created page with "## Goal Install your very own Python and keep everything under control. Questions to [David Rotermund](mailto:davrot@uni-bremen.de) We need to download a suitable Python version from [https://www.python.org](https://www.python.org). In the case we want to use PyTorch [check here](https://pytorch.org/get-started/locally/#windows-python) or TensorFlow [check here](https://www.tensorflow.org/install/pip#software_requirements) we need to check if the Python version is okay..." |
No edit summary |
||
| (5 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
Install your very own Python and keep everything under control. | Install your very own Python and keep everything under control. | ||
Questions to [ | Questions to [mailto:davrot@uni-bremen.de David Rotermund] | ||
We need to download a suitable Python version from | We need to download a suitable Python version from https://www.python.org. In the case we want to use PyTorch [https://pytorch.org/get-started/locally/#windows-python check here] or TensorFlow [https://www.tensorflow.org/install/pip#software_requirements check here] we need to check if the Python version is okay. | ||
<span id="windows"></span> | |||
== Windows == | |||
I downloaded this file: | I downloaded this file: https://www.python.org/ftp/python/3.12.7/python-3.12.7-amd64.exe | ||
<div class="figure"> | |||
Select | [[File:Image1.png|figure 1]] | ||
</div> | |||
Select “Add python.exe to Path” and then press “Install Now”. | |||
We need to update pip first: | We need to update pip first: | ||
<syntaxhighlight lang="shell">python.exe -m pip install --upgrade pip</syntaxhighlight> | |||
python.exe -m pip install --upgrade pip | === ffmpeg === | ||
You might need to create mp4 files. E.g. for saving matplotlib animations | You might need to create mp4 files. E.g. for saving matplotlib animations | ||
Thus you need ffmpeg binaries. You find them here: | Thus you need ffmpeg binaries. You find them here: https://www.gyan.dev/ffmpeg/builds/ | ||
I went for | I went for https://www.gyan.dev/ffmpeg/builds/packages/ffmpeg-6.0-full_build.7z | ||
There are differnt way to install the ffmpeg binaries (ffmpeg.exe, ffplay.exe, and ffprobe.exe). The easiest way is to put them here: | There are differnt way to install the ffmpeg binaries (ffmpeg.exe, ffplay.exe, and ffprobe.exe). The easiest way is to put them here: %LOCALAPPDATA% | ||
%LOCALAPPDATA% | === Linux === | ||
# | '''Please check the [https://devguide.python.org/getting-started/setup-building/#install-dependencies dependencies] beforehand!!!''' | ||
For Fedora: | |||
Honestly, I didn’t get this depencency thing working. And I couldn’t find a solution. However, I am installing a huge amount of packages anyway such that the required stuff is part of it. :-) | |||
<syntaxhighlight lang="shell">sudo dnf install dnf-plugins-core # install this to use 'dnf builddep' | |||
sudo dnf builddep python3</syntaxhighlight> | |||
Python installation (after the dependencies are solved): | |||
<syntaxhighlight lang="shell">mkdir PySource | |||
mkdir PySource | |||
cd PySource | cd PySource | ||
wget https://www.python.org/ftp/python/3.12.7/Python-3.12.7.tgz | wget https://www.python.org/ftp/python/3.12.7/Python-3.12.7.tgz | ||
| Line 58: | Line 50: | ||
make install | make install | ||
cd /home/[YOURUSERNAME]/P3.12/bin | cd /home/[YOURUSERNAME]/P3.12/bin | ||
./pip3 install --upgrade pip | ./pip3 install --upgrade pip</syntaxhighlight> | ||
<span id="bash-.bash_profile"></span> | |||
==== Bash (.bash_profile) ==== | |||
<syntaxhighlight lang="shell">alias pyhton3=/home/[YOURUSERNAME]/P3.12/bin/python3 | |||
alias pyhton3=/home/[YOURUSERNAME]/P3.12/bin/python3 | |||
alias pyhton=/home/[YOURUSERNAME]/P3.12/bin/python3 | alias pyhton=/home/[YOURUSERNAME]/P3.12/bin/python3 | ||
alias ipyhton=/home/[YOURUSERNAME]/P3.12/bin/ipython | alias ipyhton=/home/[YOURUSERNAME]/P3.12/bin/ipython | ||
| Line 73: | Line 63: | ||
alias ipython3=/home/[YOURUSERNAME]/P3.12/bin/ipython | alias ipython3=/home/[YOURUSERNAME]/P3.12/bin/ipython | ||
alias pip3=/home/[YOURUSERNAME]/P3.12/bin/pip3 | alias pip3=/home/[YOURUSERNAME]/P3.12/bin/pip3 | ||
alias pip=/home/[YOURUSERNAME]/P3.12/bin/pip3 | alias pip=/home/[YOURUSERNAME]/P3.12/bin/pip3</syntaxhighlight> | ||
And add '''/home/[YOURUSERNAME]/P3.12/bin''' to the '''export PATH=''' command. | |||
And add | |||
<span id="numba"></span> | |||
== Numba == | |||
{: .topic-optional} | {: .topic-optional} This is an optional topic! | ||
This is an optional topic! | |||
The question is: Is numba broken in the moment or not? First we install numpy and then numba. We will observe if numba tried to change the numpy version. | The question is: Is numba broken in the moment or not? First we install numpy and then numba. We will observe if numba tried to change the numpy version. | ||
<span id="windows-1"></span> | |||
=== Windows === | |||
<syntaxhighlight lang="shell">pip install numpy</syntaxhighlight> | |||
<syntaxhighlight lang="shell">pip install numba</syntaxhighlight> | |||
If so then you have to decide if you want to remove numba and the downgraded numpy version before continuing. I would remove it! | |||
<syntaxhighlight lang="shell">pip uninstall numpy numba</syntaxhighlight> | |||
=== Linux === | |||
<syntaxhighlight lang="shell">cd /home/[YOURUSERNAME]/P3.12/bin | |||
./pip install numpy</syntaxhighlight> | |||
<syntaxhighlight lang="shell">cd /home/[YOURUSERNAME]/P3.12/bin | |||
./pip install numba</syntaxhighlight> | |||
If so then you have to decide if you want to remove numba and the downgraded numpy version before continuing. I would remove it! | |||
<syntaxhighlight lang="shell">cd /home/[YOURUSERNAME]/P3.12/bin | |||
./pip uninstall numpy numba</syntaxhighlight> | |||
{| class="wikitable" | |||
|- | |||
! Package | |||
! | |||
|- | |||
| numba | |||
| [https://numba.pydata.org/ Numba is an open source JIT compiler that translates a subset of Python and NumPy code into fast machine code.] | |||
|} | |||
<span id="basic-packages-you-want-to-install"></span> | |||
== Basic Packages you want to install == | |||
=== Windows === | |||
<syntaxhighlight lang="shell">pip3 install numpy scipy pandas flake8 pep8-naming black matplotlib seaborn ipython jupyterlab mypy dataclasses-json dataconf ipympl pywavelets scikit-image opencv-python scikit-learn tqdm argh sympy jsmin pybind11 pybind11-stubgen pigar asciichartpy natsort ipykernel </syntaxhighlight> | |||
=== Linux === | |||
<syntaxhighlight lang="shell">cd /home/[YOURUSERNAME]/P3.12/bin | |||
cd /home/[YOURUSERNAME]/P3.12/bin | ./pip3 install numpy scipy pandas flake8 pep8-naming black matplotlib seaborn ipython jupyterlab mypy dataclasses-json dataconf ipympl pywavelets scikit-image opencv-python scikit-learn tqdm argh sympy jsmin pybind11 pybind11-stubgen pigar asciichartpy natsort ipykernel filelock importlib-metadata regex fsspec</syntaxhighlight> | ||
./pip3 install numpy scipy pandas flake8 pep8-naming black matplotlib seaborn ipython jupyterlab mypy dataclasses-json dataconf ipympl pywavelets scikit-image opencv-python scikit-learn tqdm argh sympy jsmin pybind11 pybind11-stubgen pigar asciichartpy natsort ipykernel filelock importlib-metadata regex fsspec | {| class="wikitable" | ||
|- | |||
! Package | |||
! | |||
|- | |||
| numpy | |||
| [https://numpy.org/ The fundamental package for scientific computing with Python] | |||
|- | |||
| scipy | |||
| [https://scipy.org/ Fundamental algorithms for scientific computing in Python] | |||
|- | |||
| pandas | |||
| [https://pandas.pydata.org/ pandas is a fast, powerful, flexible and easy to use open source data analysis and manipulation tool] | |||
|- | |||
| flake8 | |||
| [https://flake8.pycqa.org/en/latest/ Your Tool For Style Guide Enforcement] | |||
|- | |||
| pep8-naming | |||
| [https://pypi.org/project/pep8-naming/ Check your code against PEP 8 naming conventions] | |||
|- | |||
| black | |||
| [https://black.readthedocs.io/en/stable/index.html The uncompromising code formatter] | |||
|- | |||
| matplotlib | |||
| [https://matplotlib.org/ Visualization with Python] | |||
|- | |||
| seaborn | |||
| [https://seaborn.pydata.org/ seaborn: statistical data visualization] | |||
|- | |||
| ipython | |||
| [https://ipython.org/ IPython provides a rich architecture for interactive computing] | |||
|- | |||
| jupyterlab | |||
| [https://jupyter.org/ JupyterLab is the latest web-based interactive development environment for notebooks, code, and data.] | |||
|- | |||
| mypy | |||
| [http://mypy-lang.org/%22 Mypy is an optional static type checker for Python that aims to combine the benefits of dynamic (or “duck”) typing and static typing.] | |||
|- | |||
| dataclasses-json | |||
| [https://github.com/lidatong/dataclasses-json Easily serialize Data Classes to and from JSON] | |||
|- | |||
| dataconf | |||
| [https://github.com/zifeo/dataconf Simple dataclasses configuration management for Python with hocon/json/yaml/properties/env-vars/dict support] | |||
|- | |||
| ipympl | |||
| [https://github.com/matplotlib/ipympl Matplotlib Jupyter Integration] | |||
|- | |||
| pywavelets | |||
| [https://pywavelets.readthedocs.io/en/latest/ PyWavelets is open source wavelet transform software for Python.] | |||
|- | |||
| scikit-learn | |||
| [https://scikit-learn.org/ Simple and efficient tools for predictive data analysis] | |||
|- | |||
| scikit-image | |||
| [https://scikit-image.org/ Image processing in Python] | |||
|- | |||
| opencv-python | |||
| [https://opencv.org/ Open Source Computer Vision Library] | |||
|- | |||
| tqdm | |||
| [https://github.com/tqdm/tqdm A Fast, Extensible Progress Bar for Python and CLI] | |||
|- | |||
| argh | |||
| [https://pythonhosted.org/argh/ Building a command-line interface?] Found yourself uttering “argh!” while struggling with the API of argparse? Don’t want to lose its power but don’t need the complexity? | |||
|- | |||
| sympy | |||
| [https://www.sympy.org/en/index.html SymPy is a Python library for symbolic mathematics.] | |||
|- | |||
| jsmin | |||
| [https://github.com/tikitu/jsmin/ JavaScript minifier] | |||
|- | |||
| pybind11 | |||
| [https://github.com/pybind/pybind11 Seamless operability between C++11 and Python] | |||
|- | |||
| pybind11-stubgen | |||
| For mypy | |||
|- | |||
| pigar | |||
| [https://github.com/damnever/pigar A tool to generate requirements.txt for Python project, and more than that.] | |||
|- | |||
| asciichartpy | |||
| [https://github.com/kroitor/asciichart Nice-looking lightweight console ASCII line charts] | |||
|- | |||
| natsort | |||
| [https://github.com/SethMMorton/natsort Simple yet flexible natural sorting in Python.] | |||
|- | |||
| ipykernel | |||
| IPython Kernel for Jupyter | |||
|} | |||
=== PyTorch === | |||
[https://pytorch.org/get-started/locally/#start-locally Check here] for a installation configurator. | |||
'''Note: Even if you don’t want to use TensorFlow, you want to install it too due to the tensorboard package.''' Tensorboard allows to track the progress during learning. | |||
==== Windows ==== | |||
===== CPU only ===== | |||
<syntaxhighlight lang="shell">pip3 install torch torchvision torchaudio torchtext </syntaxhighlight> | |||
===== NVidia GPU ===== | |||
<syntaxhighlight lang="shell">pip3 install torch torchvision torchaudio torchtext --index-url https://download.pytorch.org/whl/cu121</syntaxhighlight> | |||
==== Linux ==== | |||
===== CPU only ===== | |||
<syntaxhighlight lang="shell">cd /home/[YOURUSERNAME]/P3.12/bin | |||
./pip3 install torch torchvision torchaudio torchtext --index-url https://download.pytorch.org/whl/cpu</syntaxhighlight> | |||
===== NVidia GPU ===== | |||
<syntaxhighlight lang="shell">cd /home/[YOURUSERNAME]/P3.12/bin | |||
./pip3 install torch torchvision torchaudio torchtext</syntaxhighlight> | |||
{| class="wikitable" | |||
|- | |||
! Package | |||
! | |||
|- | |||
| torch | |||
| [https://pytorch.org/ PyTorch is a Python package that provides two high-level features: a. Tensor computation (like NumPy) with strong GPU acceleration b. Deep neural networks built on a tape-based autograd system] | |||
|- | |||
| torchvision | |||
| [https://github.com/pytorch/vision The torchvision package consists of popular datasets, model architectures, and common image transformations for computer vision.] | |||
|- | |||
| torchaudio | |||
| [https://github.com/pytorch/audio The aim of torchaudio is to apply PyTorch to the audio domain.] | |||
|- | |||
| torchtext | |||
| [https://github.com/pytorch/text Models, data loaders and abstractions for language processing, powered by PyTorch] | |||
|} | |||
=== TensorFlow === | |||
==== Windows ==== | |||
===== CPU only ===== | |||
<syntaxhighlight lang="shell">pip3 install tensorflow</syntaxhighlight> | |||
===== NVidia GPU ===== | |||
<syntaxhighlight lang="shell">pip3 install tensorflow[and-cuda]</syntaxhighlight> | |||
pip3 install | ==== Linux ==== | ||
===== CPU only ===== | |||
<syntaxhighlight lang="shell">cd /home/[YOURUSERNAME]/P3.12/bin | |||
./pip3 install tensorflow</syntaxhighlight> | |||
===== NVidia GPU ===== | |||
cd /home/[YOURUSERNAME]/P3.12/bin | |||
./ | |||
pip3 install tensorflow | |||
| | <syntaxhighlight lang="shell">cd /home/[YOURUSERNAME]/P3.12/bin | ||
|- | ./pip3 install tensorflow[and-cuda]</syntaxhighlight> | ||
|tensorflow|[TensorFlow is an open source software library for high performance numerical computation. Its flexible architecture allows easy deployment of computation across a variety of platforms (CPUs, GPUs, TPUs), and from desktops to clusters of servers to mobile and edge devices.] | {| class="wikitable" | ||
|- | |||
! Package | |||
! | |||
|- | |||
| tensorflow | |||
| [https://www.tensorflow.org/ TensorFlow is an open source software library for high performance numerical computation. Its flexible architecture allows easy deployment of computation across a variety of platforms (CPUs, GPUs, TPUs), and from desktops to clusters of servers to mobile and edge devices.] | |||
|} | |||
Latest revision as of 15:41, 17 October 2025
Install your very own Python and keep everything under control.
Questions to David Rotermund
We need to download a suitable Python version from https://www.python.org. In the case we want to use PyTorch check here or TensorFlow check here we need to check if the Python version is okay.
Windows
I downloaded this file: https://www.python.org/ftp/python/3.12.7/python-3.12.7-amd64.exe
Select “Add python.exe to Path” and then press “Install Now”.
We need to update pip first:
python.exe -m pip install --upgrade pip
ffmpeg
You might need to create mp4 files. E.g. for saving matplotlib animations
Thus you need ffmpeg binaries. You find them here: https://www.gyan.dev/ffmpeg/builds/
I went for https://www.gyan.dev/ffmpeg/builds/packages/ffmpeg-6.0-full_build.7z
There are differnt way to install the ffmpeg binaries (ffmpeg.exe, ffplay.exe, and ffprobe.exe). The easiest way is to put them here: %LOCALAPPDATA%
Linux
Please check the dependencies beforehand!!!
For Fedora:
Honestly, I didn’t get this depencency thing working. And I couldn’t find a solution. However, I am installing a huge amount of packages anyway such that the required stuff is part of it. :-)
sudo dnf install dnf-plugins-core # install this to use 'dnf builddep'
sudo dnf builddep python3
Python installation (after the dependencies are solved):
mkdir PySource
cd PySource
wget https://www.python.org/ftp/python/3.12.7/Python-3.12.7.tgz
tar -xvzf Python-3.12.7.tgz
cd Python-3.12.7
./configure --prefix=/home/[YOURUSERNAME]/P3.12 --enable-optimizations
make -j 10
make install
cd /home/[YOURUSERNAME]/P3.12/bin
./pip3 install --upgrade pip
Bash (.bash_profile)
alias pyhton3=/home/[YOURUSERNAME]/P3.12/bin/python3
alias pyhton=/home/[YOURUSERNAME]/P3.12/bin/python3
alias ipyhton=/home/[YOURUSERNAME]/P3.12/bin/ipython
alias ipyhton3=/home/[YOURUSERNAME]/P3.12/bin/ipython
alias python3=/home/[YOURUSERNAME]/P3.12/bin/python3
alias python=/home/[YOURUSERNAME]/P3.12/bin/python3
alias ipython=/home/[YOURUSERNAME]/P3.12/bin/ipython
alias ipython3=/home/[YOURUSERNAME]/P3.12/bin/ipython
alias pip3=/home/[YOURUSERNAME]/P3.12/bin/pip3
alias pip=/home/[YOURUSERNAME]/P3.12/bin/pip3
And add /home/[YOURUSERNAME]/P3.12/bin to the export PATH= command.
Numba
{: .topic-optional} This is an optional topic!
The question is: Is numba broken in the moment or not? First we install numpy and then numba. We will observe if numba tried to change the numpy version.
Windows
pip install numpy
pip install numba
If so then you have to decide if you want to remove numba and the downgraded numpy version before continuing. I would remove it!
pip uninstall numpy numba
Linux
cd /home/[YOURUSERNAME]/P3.12/bin
./pip install numpy
cd /home/[YOURUSERNAME]/P3.12/bin
./pip install numba
If so then you have to decide if you want to remove numba and the downgraded numpy version before continuing. I would remove it!
cd /home/[YOURUSERNAME]/P3.12/bin
./pip uninstall numpy numba
| Package | |
|---|---|
| numba | Numba is an open source JIT compiler that translates a subset of Python and NumPy code into fast machine code. |
Basic Packages you want to install
Windows
pip3 install numpy scipy pandas flake8 pep8-naming black matplotlib seaborn ipython jupyterlab mypy dataclasses-json dataconf ipympl pywavelets scikit-image opencv-python scikit-learn tqdm argh sympy jsmin pybind11 pybind11-stubgen pigar asciichartpy natsort ipykernel
Linux
cd /home/[YOURUSERNAME]/P3.12/bin
./pip3 install numpy scipy pandas flake8 pep8-naming black matplotlib seaborn ipython jupyterlab mypy dataclasses-json dataconf ipympl pywavelets scikit-image opencv-python scikit-learn tqdm argh sympy jsmin pybind11 pybind11-stubgen pigar asciichartpy natsort ipykernel filelock importlib-metadata regex fsspec
PyTorch
Check here for a installation configurator.
Note: Even if you don’t want to use TensorFlow, you want to install it too due to the tensorboard package. Tensorboard allows to track the progress during learning.
Windows
CPU only
pip3 install torch torchvision torchaudio torchtext
NVidia GPU
pip3 install torch torchvision torchaudio torchtext --index-url https://download.pytorch.org/whl/cu121
Linux
CPU only
cd /home/[YOURUSERNAME]/P3.12/bin
./pip3 install torch torchvision torchaudio torchtext --index-url https://download.pytorch.org/whl/cpu
NVidia GPU
cd /home/[YOURUSERNAME]/P3.12/bin
./pip3 install torch torchvision torchaudio torchtext
TensorFlow
Windows
CPU only
pip3 install tensorflow
NVidia GPU
pip3 install tensorflow[and-cuda]
Linux
CPU only
cd /home/[YOURUSERNAME]/P3.12/bin
./pip3 install tensorflow
NVidia GPU
cd /home/[YOURUSERNAME]/P3.12/bin
./pip3 install tensorflow[and-cuda]
