Python-Sapelo2: Difference between revisions

From Research Computing Center Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
Line 5: Line 5:
Sapelo2
Sapelo2
=== Version ===
=== Version ===
2.7.14, 2.7.15, 2.7.16, 3.7.4, 3.8.2, 3.8.6, 3.9.5
2.7.18, 3.7.4, 3.8.6, 3.9.6, 3.10.4


=== Author / Distributor ===
=== Author / Distributor ===
Line 29: Line 29:


     Versions:
     Versions:
         Python/2.7.14-GCCcore-6.4.0-bare
         Python/2.7.18-GCCcore-11.2.0-bare
         Python/2.7.15-fosscuda-2018b
         Python/2.7.18-GCCcore-11.2.0
         Python/2.7.16-GCCcore-8.3.0
        Python/2.7.18-GCCcore-11.3.0-bare
         Python/2.7.18-GCCcore-11.3.0
         Python/3.7.4-GCCcore-8.3.0
         Python/3.7.4-GCCcore-8.3.0
        Python/3.8.2-GCCcore-8.3.0
        Python/3.8.2-GCCcore-9.3.0
         Python/3.8.6-GCCcore-10.2.0
         Python/3.8.6-GCCcore-10.2.0
         Python/3.9.5-GCCcore-10.3.0
         Python/3.9.6-GCCcore-11.2.0-bare
 
        Python/3.9.6-GCCcore-11.2.0
        Python/3.10.4-GCCcore-11.3.0-bare
        Python/3.10.4-GCCcore-11.3.0
     Other possible modules matches:
     Other possible modules matches:
         Biopython  Boost.Python  GitPython  IPython  bx-python  netcdf4-python  openslide-python
         Biopython  Boost.Python  GitPython  IPython  bx-python  flatbuffers-python  ...


------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------
   To find other possible module matches execute:
   To find other possible module matches execute:


       $ module -r spider '.*Python.*'
       $ module -r spider '.*Python.*'


------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------
   For detailed information about a specific "Python" package (including how to load the modules) use the module's full name.
   For detailed information about a specific "Python" package (including how to load the modules) use the module's full name.
   Note that names that have a trailing (E) are extensions provided by other modules.
   Note that names that have a trailing (E) are extensions provided by other modules.
   For example:
   For example:


     $ module spider Python/3.8.2-GCCcore-8.3.0
     $ module spider Python/3.10.4-GCCcore-11.3.0
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------
 
</pre>  
</pre>  


Line 76: Line 78:


     Versions:
     Versions:
         SciPy-bundle/2019.10-foss-2019b-Python-2.7.16
         SciPy-bundle/2021.10-foss-2021b-Python-2.7.18
         SciPy-bundle/2019.10-foss-2019b-Python-3.7.4
         SciPy-bundle/2021.10-foss-2021b
         SciPy-bundle/2019.10-fosscuda-2019b-Python-2.7.16
         SciPy-bundle/2021.10-foss-2022a-Python-2.7.18
        SciPy-bundle/2019.10-fosscuda-2019b-Python-3.7.4
         SciPy-bundle/2022.05-foss-2022a
        SciPy-bundle/2019.10-intel-2019b-Python-2.7.16
        SciPy-bundle/2019.10-intel-2019b-Python-3.7.4
        SciPy-bundle/2020.03-foss-2019b-Python-3.8.2
        SciPy-bundle/2020.03-fosscuda-2019b-Python-3.8.2
        SciPy-bundle/2020.11-foss-2020b
        SciPy-bundle/2020.11-fosscuda-2020b
        SciPy-bundle/2020.11-intel-2020b
         SciPy-bundle/2021.05-foss-2019b-Python-3.8.2
        SciPy-bundle/2021.10-foss-2020b-Python-3.8.6
        SciPy-bundle/2021.10-fosscuda-2020b-Python-3.8.6


 
----------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
   For detailed information about a specific "SciPy-bundle" package (including how to load the modules) use the module's full name.
   For detailed information about a specific "SciPy-bundle" package (including how to load the modules) use the module's full name.
   Note that names that have a trailing (E) are extensions provided by other modules.
   Note that names that have a trailing (E) are extensions provided by other modules.
   For example:
   For example:


     $ module spider SciPy-bundle/2020.03-foss-2019b-Python-3.8.2
     $ module spider SciPy-bundle/2022.05-foss-2022a
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------
</pre>
</pre>


Note that, when you load SciPy-bundle module, a specific version of Python that the package is built for will be loaded at first. This means that you don't have to load the Python module separately from loading SciPy-bundle module. For example, when you load SciPy-bundle/2020.03-foss-2019b-Python-3.8.2, Python 3.8.2 will be load before SciPy-bundle module is loaded.
Note that, when you load SciPy-bundle module, a specific version of Python that the package is built for will be loaded at first. This means that you don't have to load the Python module separately from loading SciPy-bundle module. For example:
 
```Note```:
 
*Python/3.9.6-GCCcore-11.2.0 will be automatically loaded when SciPy-bundle/2021.10-foss-2021b is loaded.
 
*Python/3.10.4-GCCcore-11.3.0 will be automatically loaded when SciPy-bundle/2022.05-foss-2022a is loaded.
 
*Python/2.7.18-GCCcore-11.2.0 will be automatically loaded when SciPy-bundle/2021.10-foss-2021b-Python-2.7.18 is loaded.
 
*Python/2.7.18-GCCcore-11.3.0 will be automatically loaded when SciPy-bundle/2021.10-foss-2022a-Python-2.7.18 is loaded.


----  
----  
Line 121: Line 122:


     Versions:
     Versions:
        matplotlib/2.2.3-fosscuda-2018b-Python-2.7.15
         matplotlib/2.2.5-foss-2021b-Python-2.7.18
        matplotlib/2.2.4-foss-2019b-Python-2.7.16
         matplotlib/2.2.5-foss-2022a-Python-2.7.18
        matplotlib/2.2.4-intel-2019b-Python-2.7.16
         matplotlib/3.4.3-foss-2021b
         matplotlib/2.2.5-foss-2019b-Python-2.7.16
         matplotlib/3.5.2-foss-2021b
         matplotlib/2.2.5-fosscuda-2019b-Python-2.7.16
         matplotlib/3.5.2-foss-2022a
        matplotlib/3.1.1-foss-2019b-Python-3.7.4
        matplotlib/3.1.1-foss-2019b-Python-3.8.2
        matplotlib/3.1.1-fosscuda-2019b-Python-3.7.4
         matplotlib/3.1.1-intel-2019b-Python-3.7.4
        matplotlib/3.3.3-foss-2020b
         matplotlib/3.3.3-fosscuda-2020b
        matplotlib/3.3.3-intel-2020b
        matplotlib/3.4.1-foss-2019b-Python-3.7.4
         matplotlib/3.4.1-foss-2019b-Python-3.8.2
        matplotlib/3.4.1-fosscuda-2019b-Python-3.7.4
        matplotlib/3.5.1-foss-2020b-Python-3.8.6


 
----------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
   For detailed information about a specific "matplotlib" package (including how to load the modules) use the module's full name.
   For detailed information about a specific "matplotlib" package (including how to load the modules) use the module's full name.
   Note that names that have a trailing (E) are extensions provided by other modules.
   Note that names that have a trailing (E) are extensions provided by other modules.
   For example:
   For example:


     $ module spider matplotlib/3.1.1-intel-2019b-Python-3.7.4
     $ module spider matplotlib/3.5.2-foss-2022a
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------
</pre>
</pre>


Same as SciPy-bundle, when you load matplotlib module, a specific version of Python that matplotlib is built for will be loaded at first, which means you don't have to load the Python module separately from loading matplotlib module. For example, when you load matplotlib/3.1.1-foss-2019b-Python-3.8.2, Python 3.8.2 will be load before matplotlib module is loaded.
Same as SciPy-bundle, when you load matplotlib module, a specific version of Python that matplotlib is built for will be loaded at first, which means you don't have to load the Python module separately from loading matplotlib module. For example:
 
*Python/3.9.6-GCCcore-11.2.0 will be automatically loaded when you load matplotlib/3.4.3-foss-2021b or matplotlib/3.5.2-foss-2021b.
 
*Python/3.10.4-GCCcore-11.3.0 will be automatically loaded when you load matplotlib/3.5.2-foss-2022a.
 
*Python/2.7.18-GCCcore-11.2.0 will be automatically loaded when you load matplotlib/2.2.5-foss-2021b-Python-2.7.18.
 
*Python/2.7.18-GCCcore-11.3.0 will be automatically loaded when you load matplotlib/2.2.5-foss-2022a-Python-2.7.18.


----  
----  
Line 168: Line 165:


     Versions:
     Versions:
         Biopython/1.75-foss-2019b-Python-2.7.16
         Biopython/1.79-foss-2021b
        Biopython/1.75-foss-2019b-Python-3.7.4
         Biopython/1.79-foss-2022a
        Biopython/1.75-fosscuda-2019b-Python-3.7.4
        Biopython/1.75-intel-2019b-Python-3.7.4
         Biopython/1.78-foss-2019b-Python-3.8.2
        Biopython/1.78-foss-2020b
        Biopython/1.78-fosscuda-2020b
        Biopython/1.78-intel-2020b


---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------
   For detailed information about a specific "Biopython" package (including how to load the modules) use the module's full name.
   For detailed information about a specific "Biopython" package (including how to load the modules) use the module's full name.
   Note that names that have a trailing (E) are extensions provided by other modules.
   Note that names that have a trailing (E) are extensions provided by other modules.
   For example:
   For example:


     $ module spider Biopython/1.75-intel-2019b-Python-3.7.4
     $ module spider Biopython/1.79-foss-2022a
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------
</pre>
</pre>


Same as above SciPy-bundle and matplotlib, when you load Biopython module, a specific version of Python that the package is built for will be loaded at first. You don't have to load the Python module separately from loading Biopython module. For example, when you load Biopython/1.75-foss-2019b-Python-3.7.4, Python 3.7.4 will be load before Biopython module is loaded.
Same as above SciPy-bundle and matplotlib, when you load Biopython module, a specific version of Python that the package is built for will be loaded at first. You don't have to load the Python module separately from loading Biopython module. For ecample:
 
*Python/3.9.6-GCCcore-11.2.0 will be automatically loaded when Biopython/1.79-foss-2021b is loaded.
 
*Python/3.10.4-GCCcore-11.3.0 will be automatically loaded when Biopython/1.79-foss-2022a is loaded.
 


----  
----  
Line 195: Line 191:
====Example of using Python3====
====Example of using Python3====


To use Python 3.8.2, you can use the following in the first line of your Python code:
To use Python 3.9.6, you can use the following in the first line of your Python code:


<pre class="gscript">
<pre class="gscript">
#!/apps/eb/Python/3.8.2-GCCcore-8.3.0/bin/python3
#!/apps/eb/Python/3.9.6-GCCcore-11.2.0/bin/python3
</pre>
</pre>


Line 208: Line 204:


<pre class="gcommand">
<pre class="gcommand">
module load Python/3.8.2-GCCcore-8.3.0
module load Python/3.9.6-GCCcore-11.2.0


python myProgram.py
python myProgram.py
Line 215: Line 211:
====Example of using Python2====
====Example of using Python2====


To use Python 2.7.16, you can use the following in the first line of your Python code:
To use Python 2.7.18, you can use the following in the first line of your Python code:


<pre class="gscript">
<pre class="gscript">
#!/apps/eb/Python/2.7.16-GCCcore-8.3.0/bin/python
#!/apps/eb/Python/2.7.18-GCCcore-11.2.0/bin/python
</pre>
</pre>


Line 228: Line 224:


<pre class="gcommand">
<pre class="gcommand">
module load Python/2.7.16-GCCcore-8.3.0
module load Python/2.7.18-GCCcore-11.2.0


python myProgram.py
python myProgram.py

Revision as of 12:19, 5 September 2023

Category

Programming

Program On

Sapelo2

Version

2.7.18, 3.7.4, 3.8.6, 3.9.6, 3.10.4

Author / Distributor

The Python Software Foundation

Description

Python is a programming language.

Running Program

Also refer to Running Jobs on Sapelo2

We have a set of pythons installed on Sapelo2:

ml spider Python

------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  Python:
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
      Python is a programming language that lets you work more quickly and integrate your systems more effectively.

     Versions:
        Python/2.7.18-GCCcore-11.2.0-bare
        Python/2.7.18-GCCcore-11.2.0
        Python/2.7.18-GCCcore-11.3.0-bare
        Python/2.7.18-GCCcore-11.3.0
        Python/3.7.4-GCCcore-8.3.0
        Python/3.8.6-GCCcore-10.2.0
        Python/3.9.6-GCCcore-11.2.0-bare
        Python/3.9.6-GCCcore-11.2.0
        Python/3.10.4-GCCcore-11.3.0-bare
        Python/3.10.4-GCCcore-11.3.0
     Other possible modules matches:
        Biopython  Boost.Python  GitPython  IPython  bx-python  flatbuffers-python  ...

----------------------------------------------------------------------------------
  To find other possible module matches execute:

      $ module -r spider '.*Python.*'

----------------------------------------------------------------------------------
  For detailed information about a specific "Python" package (including how to load the modules) use the module's full name.
  Note that names that have a trailing (E) are extensions provided by other modules.
  For example:

     $ module spider Python/3.10.4-GCCcore-11.3.0
----------------------------------------------------------------------------------


Back to Top

About Python packages

Some common third-party Python packages are installed individually as separate modules on the cluster.

numpy, scipy, pandas

The numpy, scipy, pandas, mpi4py, mpmath, and deap packages are installed in SciPy-bundle module:

ml spider SciPy-bundle    

-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  SciPy-bundle:
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    Description:
      Bundle of Python packages for scientific software

     Versions:
        SciPy-bundle/2021.10-foss-2021b-Python-2.7.18
        SciPy-bundle/2021.10-foss-2021b
        SciPy-bundle/2021.10-foss-2022a-Python-2.7.18
        SciPy-bundle/2022.05-foss-2022a

----------------------------------------------------------------------------------
  For detailed information about a specific "SciPy-bundle" package (including how to load the modules) use the module's full name.
  Note that names that have a trailing (E) are extensions provided by other modules.
  For example:

     $ module spider SciPy-bundle/2022.05-foss-2022a
----------------------------------------------------------------------------------

Note that, when you load SciPy-bundle module, a specific version of Python that the package is built for will be loaded at first. This means that you don't have to load the Python module separately from loading SciPy-bundle module. For example:

```Note```:

  • Python/3.9.6-GCCcore-11.2.0 will be automatically loaded when SciPy-bundle/2021.10-foss-2021b is loaded.
  • Python/3.10.4-GCCcore-11.3.0 will be automatically loaded when SciPy-bundle/2022.05-foss-2022a is loaded.
  • Python/2.7.18-GCCcore-11.2.0 will be automatically loaded when SciPy-bundle/2021.10-foss-2021b-Python-2.7.18 is loaded.
  • Python/2.7.18-GCCcore-11.3.0 will be automatically loaded when SciPy-bundle/2021.10-foss-2022a-Python-2.7.18 is loaded.

Back to Top

matplotlib

The matplotlib package is installed in matplotlib module.

ml spider matplotlib

--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  matplotlib:
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    Description:
      matplotlib is a python 2D plotting library which produces publication quality figures in a variety of hardcopy formats and interactive environments across platforms. matplotlib can be used in python
      scripts, the python and ipython shell, web application servers, and six graphical user interface toolkits.

     Versions:
        matplotlib/2.2.5-foss-2021b-Python-2.7.18
        matplotlib/2.2.5-foss-2022a-Python-2.7.18
        matplotlib/3.4.3-foss-2021b
        matplotlib/3.5.2-foss-2021b
        matplotlib/3.5.2-foss-2022a

----------------------------------------------------------------------------------
  For detailed information about a specific "matplotlib" package (including how to load the modules) use the module's full name.
  Note that names that have a trailing (E) are extensions provided by other modules.
  For example:

     $ module spider matplotlib/3.5.2-foss-2022a
----------------------------------------------------------------------------------

Same as SciPy-bundle, when you load matplotlib module, a specific version of Python that matplotlib is built for will be loaded at first, which means you don't have to load the Python module separately from loading matplotlib module. For example:

  • Python/3.9.6-GCCcore-11.2.0 will be automatically loaded when you load matplotlib/3.4.3-foss-2021b or matplotlib/3.5.2-foss-2021b.
  • Python/3.10.4-GCCcore-11.3.0 will be automatically loaded when you load matplotlib/3.5.2-foss-2022a.
  • Python/2.7.18-GCCcore-11.2.0 will be automatically loaded when you load matplotlib/2.2.5-foss-2021b-Python-2.7.18.
  • Python/2.7.18-GCCcore-11.3.0 will be automatically loaded when you load matplotlib/2.2.5-foss-2022a-Python-2.7.18.

Back to Top

Biopython

The Biopython package is installed in Biopython module.

ml spider biopython

---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  Biopython:
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    Description:
      Biopython is a set of freely available tools for biological computation written in Python by an international team of developers. It is a distributed collaborative effort to develop Python libraries
      and applications which address the needs of current and future work in bioinformatics. 

     Versions:
        Biopython/1.79-foss-2021b
        Biopython/1.79-foss-2022a

----------------------------------------------------------------------------------
  For detailed information about a specific "Biopython" package (including how to load the modules) use the module's full name.
  Note that names that have a trailing (E) are extensions provided by other modules.
  For example:

     $ module spider Biopython/1.79-foss-2022a
----------------------------------------------------------------------------------

Same as above SciPy-bundle and matplotlib, when you load Biopython module, a specific version of Python that the package is built for will be loaded at first. You don't have to load the Python module separately from loading Biopython module. For ecample:

  • Python/3.9.6-GCCcore-11.2.0 will be automatically loaded when Biopython/1.79-foss-2021b is loaded.
  • Python/3.10.4-GCCcore-11.3.0 will be automatically loaded when Biopython/1.79-foss-2022a is loaded.



Back to Top

Examples

Example of using Python3

To use Python 3.9.6, you can use the following in the first line of your Python code:

#!/apps/eb/Python/3.9.6-GCCcore-11.2.0/bin/python3

Or use the following line in the first line of your Python code:

#!/usr/bin/env python

an then you run your program as:

module load Python/3.9.6-GCCcore-11.2.0

python myProgram.py

Example of using Python2

To use Python 2.7.18, you can use the following in the first line of your Python code:

#!/apps/eb/Python/2.7.18-GCCcore-11.2.0/bin/python

Or use the following line in the first line of your Python code:

#!/usr/bin/env python

an then you run your program as:

module load Python/2.7.18-GCCcore-11.2.0

python myProgram.py

Back to Top

Documentation

Please see http://www.python.org/

Installation

EasyBuild recipes

System

64-bit Linux