QIIME2-Sapelo2: Difference between revisions

From Research Computing Center Wiki
Jump to navigation Jump to search
(Created page with "Category:Sapelo2Category:SoftwareCategory:Bioinformatics === Category === Bioinformatics === Program On === Sapelo2 === Version === v2019.10, v2020.2 2020.6,...")
 
 
(8 intermediate revisions by 2 users not shown)
Line 10: Line 10:
=== Version ===
=== Version ===


v2019.10, v2020.2 2020.6, v2020.11
2020.6, 2023.2, 2023.5.1, 2023.7, 2023.9, 2024.2


=== Author / Distributor ===
=== Author / Distributor ===
Line 24: Line 24:


Also refer to [[Running Jobs on Sapelo2]]
Also refer to [[Running Jobs on Sapelo2]]
Also refer to [[Running_Jobs_on_Sapelo2#Running_an_X-windows_application | Run X window Jobs]] and
[[Running_Jobs_on_Sapelo2#Running_an_Interactive_Job | Run interactive Jobs]]


*Version 2018.8, installed at /usr/local/apps/eb/QIIME2/2018.8; Plug-in q2-fragment-insertion is installed under same location.
*Version 2020.6 installed as a conda environment at /apps/eb/QIIME2/2020.6
*Version 2018.11, installed at /usr/local/apps/eb/QIIME2/2018.11
*Version 2023.2 installed as a conda environment at /apps/eb/QIIME2/2023.2
*Version 2019.7, installed as a conda virtual environment at /usr/local/apps/gb/qiime2/2019.7
*Version 2023.5.1 installed as a conda environment at /apps/eb/QIIME2/2023.5.1-foss-2022a
*Version 2020.6, installed at /usr/local/apps/eb/QIIME2/2020.6
*Version 2023.7 installed as a conda environment at /apps/eb/QIIME2/2023.7


 
To use version 2020.6, please first load the module with
To use version 2018.8, please first load the module with


<pre class="gscript">
<pre class="gscript">
module load QIIME2/2018.8
module load QIIME2/2020.6
</pre>
 
To use version 2018.11, please first load the module with
 
<pre class="gscript">
module load QIIME2/2018.11
</pre>  
</pre>  


To use version 2019.7, please first load the module with
To use version2023.2, please first load the module with


<pre class="gscript">
<pre class="gscript">
module load qiime2/2019.7_conda
module load QIIME2/2023.2
</pre>  
</pre>  


To use version 2020.6, please first load the module with
To use version 2023.5.1, please first load the module with


<pre class="gscript">
<pre class="gscript">
module load QIIME2/2020.6
module load QIIME2/2023.5.1-foss-2022a
</pre>  
</pre>  


To use version 2023.7, please first load the module with


Example of a shell script sub.sh to run qiime v2018.11 at the batch queue:
<pre class="gscript">
<pre class="gscript">
#!/bin/bash
module load QIIME2/2023.7
 
#PBS -N j_qiime2
#PBS -q batch
#PBS -l nodes=1:ppn=1
#PBS -l walltime=24:00:00
#PBS -l mem=10gb
 
cd $PBS_O_WORKDIR
 
module load QIIME2/2018.11
echo "backend: Agg" > ~/.config/matplotlib/matplotlibrc
qiime [OPTIONS] COMMAND [ARGS]...
</pre>  
</pre>  


where [OPTIONS], COMMAND, and [ARGS] need to be replaced by the options, command, and arguments you want to use. Other parameters of the job, such as the maximum wall clock time, maximum memory, the number cores per node, and the job name need to be modified appropriately as well.


Example of a shell script sub.sh to run qiime v2019.7 at the batch queue:  
Example of a shell script sub.sh to run QIIME2 2023.7 at the batch queue:  
<pre class="gscript">
<pre class="gscript">
#!/bin/bash
#!/bin/bash
#SBATCH --job-name=j_qiime2          # Job name
#SBATCH --partition=batch            # Partition (queue) name
#SBATCH --ntasks=1                    # Run on a single CPU by default
#SBATCH --cpus-per-task=1            # Number of CPU cores per task
#SBATCH --mem=20gb                    # Job memory request
#SBATCH --time=48:00:00              # Time limit hrs:min:sec
#SBATCH --output=log.%j.out          # Standard output log
#SBATCH --error=log.%j.err            # Standard error log


#PBS -N j_qiime2
#SBATCH --mail-type=ALL              # Mail events (NONE, BEGIN, END, FAIL, ALL)
#PBS -q batch
#SBATCH --mail-user=username@uga.edu  # Where to send mail
#PBS -l nodes=1:ppn=1
#PBS -l walltime=24:00:00
#PBS -l mem=10gb
 
cd $PBS_O_WORKDIR
 
module load qiime2/2019.7_conda
source activate ${ROOT_qiime2}
echo "backend: Agg" > ~/.config/matplotlib/matplotlibrc
qiime [OPTIONS] COMMAND [ARGS]...
conda deactivate
</pre>
 
where ROOT_qiime2 is the environment variable storing QIIME2/2019.7 installation path, i.e./usr/local/apps/gb/qiime2/2019.7; [OPTIONS], COMMAND, and [ARGS] need to be replaced by the options, command, and arguments you want to use. Other parameters of the job, such as the maximum wall clock time, maximum memory, the number cores per node, and the job name need to be modified appropriately as well.
 
Example of a shell script sub.sh to run qiime v2020.6 at the batch queue:
<pre class="gscript">
#!/bin/bash


#PBS -N j_qiime2
cd $SLURM_SUBMIT_DIR
#PBS -q batch
#PBS -l nodes=1:ppn=1
#PBS -l walltime=24:00:00
#PBS -l mem=10gb


cd $PBS_O_WORKDIR
ml QIIME2/2023.7


module load QIIME2/2020.6
echo "backend: Agg" > ~/.config/matplotlib/matplotlibrc
echo "backend: Agg" > ~/.config/matplotlib/matplotlibrc
qiime [OPTIONS] COMMAND [ARGS]...
qiime [OPTIONS] COMMAND [ARGS]...
Line 120: Line 83:
Example of job submission
Example of job submission
<pre  class="gcommand">
<pre  class="gcommand">
qsub  ./sub.sh  
sbatch ./sub.sh  
</pre>
</pre>


=== Documentation ===
=== Documentation ===
 
<pre class="gcommand">
 
module load QIIME2/2018.8
<pre class="gcommand">
qiime
[cft07037@b1-24 singularity-images]$ ml QIIME2/2023.2
[cft07037@b1-24 singularity-images]$ qiime --help
Usage: qiime [OPTIONS] COMMAND [ARGS]...
Usage: qiime [OPTIONS] COMMAND [ARGS]...


Line 143: Line 107:
   your .zshrc:
   your .zshrc:


       autoload bashcompinit && bashcompinit && source tab-qiime
       autoload -Uz compinit && compinit
      autoload bashcompinit && bashcompinit
      source tab-qiime


Options:
Options:
   --version Show the version and exit.
   --version   Show the version and exit.
   --help     Show this message and exit.
   --help     Show this message and exit.


Commands:
Commands:
Line 161: Line 127:
   demux              Plugin for demultiplexing & viewing sequence quality.
   demux              Plugin for demultiplexing & viewing sequence quality.
   diversity          Plugin for exploring community diversity.
   diversity          Plugin for exploring community diversity.
  diversity-lib      Plugin for computing community diversity.
   emperor            Plugin for ordination plotting with Emperor.
   emperor            Plugin for ordination plotting with Emperor.
   feature-classifier  Plugin for taxonomic classification.
   feature-classifier  Plugin for taxonomic classification.
Line 166: Line 133:
   fragment-insertion  Plugin for extending phylogenies.
   fragment-insertion  Plugin for extending phylogenies.
   gneiss              Plugin for building compositional models.
   gneiss              Plugin for building compositional models.
  greengenes2        Methods for interaction with Greengenes2
   longitudinal        Plugin for paired sample and time series analyses.
   longitudinal        Plugin for paired sample and time series analyses.
   metadata            Plugin for working with Metadata.
   metadata            Plugin for working with Metadata.
Line 181: Line 149:
   
   
source code from [https://qiime2.org/ QIIME2]
source code from [https://qiime2.org/ QIIME2]
source code from [https://github.com/biocore/q2-fragment-insertion q2-fragment-insertion]
   
   
=== System ===
=== System ===
64-bit Linux
64-bit Linux

Latest revision as of 07:28, 14 May 2024

Category

Bioinformatics

Program On

Sapelo2

Version

2020.6, 2023.2, 2023.5.1, 2023.7, 2023.9, 2024.2

Author / Distributor

QIIME2

Description

QIIME 2™ is a next-generation microbiome bioinformatics platform that is extensible, free, open source, and community developed."

More details are at QIIME2

Running Program

Also refer to Running Jobs on Sapelo2

  • Version 2020.6 installed as a conda environment at /apps/eb/QIIME2/2020.6
  • Version 2023.2 installed as a conda environment at /apps/eb/QIIME2/2023.2
  • Version 2023.5.1 installed as a conda environment at /apps/eb/QIIME2/2023.5.1-foss-2022a
  • Version 2023.7 installed as a conda environment at /apps/eb/QIIME2/2023.7

To use version 2020.6, please first load the module with

module load QIIME2/2020.6

To use version2023.2, please first load the module with

module load QIIME2/2023.2

To use version 2023.5.1, please first load the module with

module load QIIME2/2023.5.1-foss-2022a

To use version 2023.7, please first load the module with

module load QIIME2/2023.7


Example of a shell script sub.sh to run QIIME2 2023.7 at the batch queue:

#!/bin/bash
#SBATCH --job-name=j_qiime2           # Job name
#SBATCH --partition=batch             # Partition (queue) name
#SBATCH --ntasks=1                    # Run on a single CPU by default
#SBATCH --cpus-per-task=1             # Number of CPU cores per task
#SBATCH --mem=20gb                    # Job memory request
#SBATCH --time=48:00:00               # Time limit hrs:min:sec
#SBATCH --output=log.%j.out           # Standard output log
#SBATCH --error=log.%j.err            # Standard error log

#SBATCH --mail-type=ALL               # Mail events (NONE, BEGIN, END, FAIL, ALL)
#SBATCH --mail-user=username@uga.edu  # Where to send mail	

cd $SLURM_SUBMIT_DIR

ml QIIME2/2023.7

echo "backend: Agg" > ~/.config/matplotlib/matplotlibrc
qiime [OPTIONS] COMMAND [ARGS]...

where [OPTIONS], COMMAND, and [ARGS] need to be replaced by the options, command, and arguments you want to use. Other parameters of the job, such as the maximum wall clock time, maximum memory, the number cores per node, and the job name need to be modified appropriately as well.


Example of job submission

sbatch ./sub.sh 

Documentation

[cft07037@b1-24 singularity-images]$ ml QIIME2/2023.2
[cft07037@b1-24 singularity-images]$ qiime --help
Usage: qiime [OPTIONS] COMMAND [ARGS]...

  QIIME 2 command-line interface (q2cli)
  --------------------------------------

  To get help with QIIME 2, visit https://qiime2.org.

  To enable tab completion in Bash, run the following command or add it to
  your .bashrc/.bash_profile:

      source tab-qiime

  To enable tab completion in ZSH, run the following commands or add them to
  your .zshrc:

      autoload -Uz compinit && compinit
      autoload bashcompinit && bashcompinit
      source tab-qiime

Options:
  --version   Show the version and exit.
  --help      Show this message and exit.

Commands:
  info                Display information about current deployment.
  tools               Tools for working with QIIME 2 files.
  dev                 Utilities for developers and advanced users.
  alignment           Plugin for generating and manipulating alignments.
  composition         Plugin for compositional data analysis.
  cutadapt            Plugin for removing adapter sequences, primers, and
                      other unwanted sequence from sequence data.
  dada2               Plugin for sequence quality control with DADA2.
  deblur              Plugin for sequence quality control with Deblur.
  demux               Plugin for demultiplexing & viewing sequence quality.
  diversity           Plugin for exploring community diversity.
  diversity-lib       Plugin for computing community diversity.
  emperor             Plugin for ordination plotting with Emperor.
  feature-classifier  Plugin for taxonomic classification.
  feature-table       Plugin for working with sample by feature tables.
  fragment-insertion  Plugin for extending phylogenies.
  gneiss              Plugin for building compositional models.
  greengenes2         Methods for interaction with Greengenes2
  longitudinal        Plugin for paired sample and time series analyses.
  metadata            Plugin for working with Metadata.
  phylogeny           Plugin for generating and manipulating phylogenies.
  quality-control     Plugin for quality control of feature and sequence data.
  quality-filter      Plugin for PHRED-based filtering and trimming.
  sample-classifier   Plugin for machine learning prediction of sample
                      metadata.
  taxa                Plugin for working with feature taxonomy annotations.
  vsearch             Plugin for clustering and dereplicating with vsearch.

Back to Top

Installation

source code from QIIME2

System

64-bit Linux