QIIME2-Sapelo2: Difference between revisions

From Research Computing Center Wiki
Jump to navigation Jump to search
No edit summary
 
(3 intermediate revisions by 2 users not shown)
Line 10: Line 10:
=== Version ===
=== Version ===


2019.10, 2020.2, 2020.6, 2020.11
2020.6, 2023.2, 2023.5.1, 2023.7, 2023.9, 2024.2


=== Author / Distributor ===
=== Author / Distributor ===
Line 25: Line 25:
Also refer to [[Running Jobs on Sapelo2]]
Also refer to [[Running Jobs on Sapelo2]]


*Version 2019.10 installed as a conda environment at /apps/eb/QIIME2/2019.10
*Version 2020.2 installed as a conda environment at /apps/eb/QIIME2/2020.2
*Version 2020.6 installed as a conda environment at /apps/eb/QIIME2/2020.6
*Version 2020.6 installed as a conda environment at /apps/eb/QIIME2/2020.6
*Version 2020.11 installed as a conda environment at /apps/eb/QIIME2/2020.11
*Version 2023.2 installed as a conda environment at /apps/eb/QIIME2/2023.2
*Version 2023.5.1 installed as a conda environment at /apps/eb/QIIME2/2023.5.1-foss-2022a
*Version 2023.7 installed as a conda environment at /apps/eb/QIIME2/2023.7


To use version 2019.10, please first load the module with
To use version 2020.6, please first load the module with


<pre class="gscript">
<pre class="gscript">
module load QIIME2/2019.10
module load QIIME2/2020.6
</pre>  
</pre>  


To use version 2020.2, please first load the module with
To use version2023.2, please first load the module with


<pre class="gscript">
<pre class="gscript">
module load QIIME2/2020.2
module load QIIME2/2023.2
</pre>  
</pre>  


To use version 2020.6, please first load the module with
To use version 2023.5.1, please first load the module with


<pre class="gscript">
<pre class="gscript">
module load QIIME2/2020.6
module load QIIME2/2023.5.1-foss-2022a
</pre>  
</pre>  


To use version 2020.11, please first load the module with
To use version 2023.7, please first load the module with


<pre class="gscript">
<pre class="gscript">
module load QIIME2/2020.11
module load QIIME2/2023.7
</pre>  
</pre>  




Example of a shell script sub.sh to run QIIME2 2020.11 at the batch queue:  
Example of a shell script sub.sh to run QIIME2 2023.7 at the batch queue:  
<pre class="gscript">
<pre class="gscript">
#!/bin/bash
#!/bin/bash
#SBATCH --job-name=j_qiime2          # Job name
#SBATCH --job-name=j_qiime2          # Job name
#SBATCH --partition=batch            # Partition (queue) name
#SBATCH --partition=batch            # Partition (queue) name
#SBATCH --ntasks=1                    # Run on a single CPU
#SBATCH --ntasks=1                    # Run on a single CPU by default
 
#SBATCH --cpus-per-task=1            # Number of CPU cores per task
#SBATCH --mem=20gb                    # Job memory request
#SBATCH --mem=20gb                    # Job memory request
#SBATCH --time=02:00:00              # Time limit hrs:min:sec
#SBATCH --time=48:00:00              # Time limit hrs:min:sec
#SBATCH --output=testserial.%j.out   # Standard output log
#SBATCH --output=log.%j.out           # Standard output log
#SBATCH --error=testserial.%j.err     # Standard error log
#SBATCH --error=log.%j.err           # Standard error log


#SBATCH --mail-type=END,FAIL          # Mail events (NONE, BEGIN, END, FAIL, ALL)
#SBATCH --mail-type=ALL              # Mail events (NONE, BEGIN, END, FAIL, ALL)
#SBATCH --mail-user=username@uga.edu  # Where to send mail
#SBATCH --mail-user=username@uga.edu  # Where to send mail


cd $SLURM_SUBMIT_DIR
cd $SLURM_SUBMIT_DIR


module load QIIME2/2020.11
ml QIIME2/2023.7


echo "backend: Agg" > ~/.config/matplotlib/matplotlibrc
echo "backend: Agg" > ~/.config/matplotlib/matplotlibrc
Line 83: Line 83:
Example of job submission
Example of job submission
<pre  class="gcommand">
<pre  class="gcommand">
sbatch ./sub.sh  
sbatch ./sub.sh  
</pre>
</pre>


=== Documentation ===
=== Documentation ===
 
<pre class="gcommand">
 
module load QIIME2/2018.8
<pre class="gcommand">
qiime
[cft07037@b1-24 singularity-images]$ ml QIIME2/2023.2
[cft07037@b1-24 singularity-images]$ qiime --help
Usage: qiime [OPTIONS] COMMAND [ARGS]...
Usage: qiime [OPTIONS] COMMAND [ARGS]...


Line 106: Line 107:
   your .zshrc:
   your .zshrc:


       autoload bashcompinit && bashcompinit && source tab-qiime
       autoload -Uz compinit && compinit
      autoload bashcompinit && bashcompinit
      source tab-qiime


Options:
Options:
   --version Show the version and exit.
   --version   Show the version and exit.
   --help     Show this message and exit.
   --help     Show this message and exit.


Commands:
Commands:
Line 124: Line 127:
   demux              Plugin for demultiplexing & viewing sequence quality.
   demux              Plugin for demultiplexing & viewing sequence quality.
   diversity          Plugin for exploring community diversity.
   diversity          Plugin for exploring community diversity.
  diversity-lib      Plugin for computing community diversity.
   emperor            Plugin for ordination plotting with Emperor.
   emperor            Plugin for ordination plotting with Emperor.
   feature-classifier  Plugin for taxonomic classification.
   feature-classifier  Plugin for taxonomic classification.
Line 129: Line 133:
   fragment-insertion  Plugin for extending phylogenies.
   fragment-insertion  Plugin for extending phylogenies.
   gneiss              Plugin for building compositional models.
   gneiss              Plugin for building compositional models.
  greengenes2        Methods for interaction with Greengenes2
   longitudinal        Plugin for paired sample and time series analyses.
   longitudinal        Plugin for paired sample and time series analyses.
   metadata            Plugin for working with Metadata.
   metadata            Plugin for working with Metadata.
Line 144: Line 149:
   
   
source code from [https://qiime2.org/ QIIME2]
source code from [https://qiime2.org/ QIIME2]
source code from [https://github.com/biocore/q2-fragment-insertion q2-fragment-insertion]
   
   
=== System ===
=== System ===
64-bit Linux
64-bit Linux

Latest revision as of 07:28, 14 May 2024

Category

Bioinformatics

Program On

Sapelo2

Version

2020.6, 2023.2, 2023.5.1, 2023.7, 2023.9, 2024.2

Author / Distributor

QIIME2

Description

QIIME 2™ is a next-generation microbiome bioinformatics platform that is extensible, free, open source, and community developed."

More details are at QIIME2

Running Program

Also refer to Running Jobs on Sapelo2

  • Version 2020.6 installed as a conda environment at /apps/eb/QIIME2/2020.6
  • Version 2023.2 installed as a conda environment at /apps/eb/QIIME2/2023.2
  • Version 2023.5.1 installed as a conda environment at /apps/eb/QIIME2/2023.5.1-foss-2022a
  • Version 2023.7 installed as a conda environment at /apps/eb/QIIME2/2023.7

To use version 2020.6, please first load the module with

module load QIIME2/2020.6

To use version2023.2, please first load the module with

module load QIIME2/2023.2

To use version 2023.5.1, please first load the module with

module load QIIME2/2023.5.1-foss-2022a

To use version 2023.7, please first load the module with

module load QIIME2/2023.7


Example of a shell script sub.sh to run QIIME2 2023.7 at the batch queue:

#!/bin/bash
#SBATCH --job-name=j_qiime2           # Job name
#SBATCH --partition=batch             # Partition (queue) name
#SBATCH --ntasks=1                    # Run on a single CPU by default
#SBATCH --cpus-per-task=1             # Number of CPU cores per task
#SBATCH --mem=20gb                    # Job memory request
#SBATCH --time=48:00:00               # Time limit hrs:min:sec
#SBATCH --output=log.%j.out           # Standard output log
#SBATCH --error=log.%j.err            # Standard error log

#SBATCH --mail-type=ALL               # Mail events (NONE, BEGIN, END, FAIL, ALL)
#SBATCH --mail-user=username@uga.edu  # Where to send mail	

cd $SLURM_SUBMIT_DIR

ml QIIME2/2023.7

echo "backend: Agg" > ~/.config/matplotlib/matplotlibrc
qiime [OPTIONS] COMMAND [ARGS]...

where [OPTIONS], COMMAND, and [ARGS] need to be replaced by the options, command, and arguments you want to use. Other parameters of the job, such as the maximum wall clock time, maximum memory, the number cores per node, and the job name need to be modified appropriately as well.


Example of job submission

sbatch ./sub.sh 

Documentation

[cft07037@b1-24 singularity-images]$ ml QIIME2/2023.2
[cft07037@b1-24 singularity-images]$ qiime --help
Usage: qiime [OPTIONS] COMMAND [ARGS]...

  QIIME 2 command-line interface (q2cli)
  --------------------------------------

  To get help with QIIME 2, visit https://qiime2.org.

  To enable tab completion in Bash, run the following command or add it to
  your .bashrc/.bash_profile:

      source tab-qiime

  To enable tab completion in ZSH, run the following commands or add them to
  your .zshrc:

      autoload -Uz compinit && compinit
      autoload bashcompinit && bashcompinit
      source tab-qiime

Options:
  --version   Show the version and exit.
  --help      Show this message and exit.

Commands:
  info                Display information about current deployment.
  tools               Tools for working with QIIME 2 files.
  dev                 Utilities for developers and advanced users.
  alignment           Plugin for generating and manipulating alignments.
  composition         Plugin for compositional data analysis.
  cutadapt            Plugin for removing adapter sequences, primers, and
                      other unwanted sequence from sequence data.
  dada2               Plugin for sequence quality control with DADA2.
  deblur              Plugin for sequence quality control with Deblur.
  demux               Plugin for demultiplexing & viewing sequence quality.
  diversity           Plugin for exploring community diversity.
  diversity-lib       Plugin for computing community diversity.
  emperor             Plugin for ordination plotting with Emperor.
  feature-classifier  Plugin for taxonomic classification.
  feature-table       Plugin for working with sample by feature tables.
  fragment-insertion  Plugin for extending phylogenies.
  gneiss              Plugin for building compositional models.
  greengenes2         Methods for interaction with Greengenes2
  longitudinal        Plugin for paired sample and time series analyses.
  metadata            Plugin for working with Metadata.
  phylogeny           Plugin for generating and manipulating phylogenies.
  quality-control     Plugin for quality control of feature and sequence data.
  quality-filter      Plugin for PHRED-based filtering and trimming.
  sample-classifier   Plugin for machine learning prediction of sample
                      metadata.
  taxa                Plugin for working with feature taxonomy annotations.
  vsearch             Plugin for clustering and dereplicating with vsearch.

Back to Top

Installation

source code from QIIME2

System

64-bit Linux