QIIME2-Sapelo2: Difference between revisions

From Research Computing Center Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
(4 intermediate revisions by the same user not shown)
Line 30: Line 30:
*Version 2020.11 installed as a conda environment at /apps/eb/QIIME2/2020.11
*Version 2020.11 installed as a conda environment at /apps/eb/QIIME2/2020.11


To use version 2018.8, please first load the module with
To use version 2019.10, please first load the module with


<pre class="gscript">
<pre class="gscript">
module load QIIME2/2018.8
module load QIIME2/2019.10
</pre>  
</pre>  


To use version 2018.11, please first load the module with
To use version 2020.2, please first load the module with


<pre class="gscript">
<pre class="gscript">
module load QIIME2/2018.11
module load QIIME2/2020.2
</pre>
 
To use version 2019.7, please first load the module with
 
<pre class="gscript">
module load qiime2/2019.7_conda
</pre>  
</pre>  


Line 54: Line 48:
</pre>  
</pre>  


To use version 2020.11, please first load the module with


Example of a shell script sub.sh to run qiime v2018.11 at the batch queue:
<pre class="gscript">
<pre class="gscript">
#!/bin/bash
module load QIIME2/2020.11
 
#PBS -N j_qiime2
#PBS -q batch
#PBS -l nodes=1:ppn=1
#PBS -l walltime=24:00:00
#PBS -l mem=10gb
 
cd $PBS_O_WORKDIR
 
module load QIIME2/2018.11
echo "backend: Agg" > ~/.config/matplotlib/matplotlibrc
qiime [OPTIONS] COMMAND [ARGS]...
</pre>  
</pre>  


where [OPTIONS], COMMAND, and [ARGS] need to be replaced by the options, command, and arguments you want to use. Other parameters of the job, such as the maximum wall clock time, maximum memory, the number cores per node, and the job name need to be modified appropriately as well.


Example of a shell script sub.sh to run qiime v2019.7 at the batch queue:  
Example of a shell script sub.sh to run QIIME2 2020.11 at the batch queue:  
<pre class="gscript">
<pre class="gscript">
#!/bin/bash
#!/bin/bash
#SBATCH --job-name=j_qiime2          # Job name
#SBATCH --partition=batch            # Partition (queue) name
#SBATCH --ntasks=1                    # Run on a single CPU by default
#SBATCH --cpus-per-task=1            # Number of CPU cores per task
#SBATCH --mem=20gb                    # Job memory request
#SBATCH --time=48:00:00              # Time limit hrs:min:sec
#SBATCH --output=log.%j.out          # Standard output log
#SBATCH --error=log.%j.err            # Standard error log


#PBS -N j_qiime2
#SBATCH --mail-type=ALL              # Mail events (NONE, BEGIN, END, FAIL, ALL)
#PBS -q batch
#SBATCH --mail-user=username@uga.edu  # Where to send mail
#PBS -l nodes=1:ppn=1
#PBS -l walltime=24:00:00
#PBS -l mem=10gb
 
cd $PBS_O_WORKDIR
 
module load qiime2/2019.7_conda
source activate ${ROOT_qiime2}
echo "backend: Agg" > ~/.config/matplotlib/matplotlibrc
qiime [OPTIONS] COMMAND [ARGS]...
conda deactivate
</pre>
 
where ROOT_qiime2 is the environment variable storing QIIME2/2019.7 installation path, i.e./usr/local/apps/gb/qiime2/2019.7; [OPTIONS], COMMAND, and [ARGS] need to be replaced by the options, command, and arguments you want to use. Other parameters of the job, such as the maximum wall clock time, maximum memory, the number cores per node, and the job name need to be modified appropriately as well.


Example of a shell script sub.sh to run qiime v2020.6 at the batch queue:
cd $SLURM_SUBMIT_DIR
<pre class="gscript">
#!/bin/bash


#PBS -N j_qiime2
ml QIIME2/2020.11
#PBS -q batch
#PBS -l nodes=1:ppn=1
#PBS -l walltime=24:00:00
#PBS -l mem=10gb


cd $PBS_O_WORKDIR
module load QIIME2/2020.6
echo "backend: Agg" > ~/.config/matplotlib/matplotlibrc
echo "backend: Agg" > ~/.config/matplotlib/matplotlibrc
qiime [OPTIONS] COMMAND [ARGS]...
qiime [OPTIONS] COMMAND [ARGS]...
Line 117: Line 83:
Example of job submission
Example of job submission
<pre  class="gcommand">
<pre  class="gcommand">
qsub  ./sub.sh  
sbatch ./sub.sh  
</pre>
</pre>


=== Documentation ===
=== Documentation ===
 
 
<pre  class="gcommand">
<pre  class="gcommand">
module load QIIME2/2018.8
ml QIIME2/2020.11
qiime
qiime --help
 
Usage: qiime [OPTIONS] COMMAND [ARGS]...
Usage: qiime [OPTIONS] COMMAND [ARGS]...


Line 143: Line 111:


Options:
Options:
   --version Show the version and exit.
   --version   Show the version and exit.
   --help     Show this message and exit.
   --help     Show this message and exit.


Commands:
Commands:
Line 154: Line 122:
   cutadapt            Plugin for removing adapter sequences, primers, and
   cutadapt            Plugin for removing adapter sequences, primers, and
                       other unwanted sequence from sequence data.
                       other unwanted sequence from sequence data.
   dada2              Plugin for sequence quality control with DADA2.
   dada2              Plugin for sequence quality control with DADA2.
   deblur              Plugin for sequence quality control with Deblur.
   deblur              Plugin for sequence quality control with Deblur.
   demux              Plugin for demultiplexing & viewing sequence quality.
   demux              Plugin for demultiplexing & viewing sequence quality.
   diversity          Plugin for exploring community diversity.
   diversity          Plugin for exploring community diversity.
  diversity-lib      Plugin for computing community diversity.
   emperor            Plugin for ordination plotting with Emperor.
   emperor            Plugin for ordination plotting with Emperor.
   feature-classifier  Plugin for taxonomic classification.
   feature-classifier  Plugin for taxonomic classification.
Line 170: Line 140:
   sample-classifier  Plugin for machine learning prediction of sample
   sample-classifier  Plugin for machine learning prediction of sample
                       metadata.
                       metadata.
   taxa                Plugin for working with feature taxonomy annotations.
   taxa                Plugin for working with feature taxonomy annotations.
   vsearch            Plugin for clustering and dereplicating with vsearch.
   vsearch            Plugin for clustering and dereplicating with vsearch.
Line 178: Line 149:
   
   
source code from [https://qiime2.org/ QIIME2]
source code from [https://qiime2.org/ QIIME2]
source code from [https://github.com/biocore/q2-fragment-insertion q2-fragment-insertion]
   
   
=== System ===
=== System ===
64-bit Linux
64-bit Linux

Revision as of 16:55, 7 May 2021

Category

Bioinformatics

Program On

Sapelo2

Version

2019.10, 2020.2, 2020.6, 2020.11

Author / Distributor

QIIME2

Description

QIIME 2™ is a next-generation microbiome bioinformatics platform that is extensible, free, open source, and community developed."

More details are at QIIME2

Running Program

Also refer to Running Jobs on Sapelo2

  • Version 2019.10 installed as a conda environment at /apps/eb/QIIME2/2019.10
  • Version 2020.2 installed as a conda environment at /apps/eb/QIIME2/2020.2
  • Version 2020.6 installed as a conda environment at /apps/eb/QIIME2/2020.6
  • Version 2020.11 installed as a conda environment at /apps/eb/QIIME2/2020.11

To use version 2019.10, please first load the module with

module load QIIME2/2019.10

To use version 2020.2, please first load the module with

module load QIIME2/2020.2

To use version 2020.6, please first load the module with

module load QIIME2/2020.6

To use version 2020.11, please first load the module with

module load QIIME2/2020.11


Example of a shell script sub.sh to run QIIME2 2020.11 at the batch queue:

#!/bin/bash
#SBATCH --job-name=j_qiime2           # Job name
#SBATCH --partition=batch             # Partition (queue) name
#SBATCH --ntasks=1                    # Run on a single CPU by default
#SBATCH --cpus-per-task=1             # Number of CPU cores per task
#SBATCH --mem=20gb                    # Job memory request
#SBATCH --time=48:00:00               # Time limit hrs:min:sec
#SBATCH --output=log.%j.out           # Standard output log
#SBATCH --error=log.%j.err            # Standard error log

#SBATCH --mail-type=ALL               # Mail events (NONE, BEGIN, END, FAIL, ALL)
#SBATCH --mail-user=username@uga.edu  # Where to send mail	

cd $SLURM_SUBMIT_DIR

ml QIIME2/2020.11

echo "backend: Agg" > ~/.config/matplotlib/matplotlibrc
qiime [OPTIONS] COMMAND [ARGS]...

where [OPTIONS], COMMAND, and [ARGS] need to be replaced by the options, command, and arguments you want to use. Other parameters of the job, such as the maximum wall clock time, maximum memory, the number cores per node, and the job name need to be modified appropriately as well.


Example of job submission

sbatch ./sub.sh 

Documentation

ml QIIME2/2020.11
qiime --help

Usage: qiime [OPTIONS] COMMAND [ARGS]...

  QIIME 2 command-line interface (q2cli)
  --------------------------------------

  To get help with QIIME 2, visit https://qiime2.org.

  To enable tab completion in Bash, run the following command or add it to
  your .bashrc/.bash_profile:

      source tab-qiime

  To enable tab completion in ZSH, run the following commands or add them to
  your .zshrc:

      autoload bashcompinit && bashcompinit && source tab-qiime

Options:
  --version   Show the version and exit.
  --help      Show this message and exit.

Commands:
  info                Display information about current deployment.
  tools               Tools for working with QIIME 2 files.
  dev                 Utilities for developers and advanced users.
  alignment           Plugin for generating and manipulating alignments.
  composition         Plugin for compositional data analysis.
  cutadapt            Plugin for removing adapter sequences, primers, and
                      other unwanted sequence from sequence data.

  dada2               Plugin for sequence quality control with DADA2.
  deblur              Plugin for sequence quality control with Deblur.
  demux               Plugin for demultiplexing & viewing sequence quality.
  diversity           Plugin for exploring community diversity.
  diversity-lib       Plugin for computing community diversity.
  emperor             Plugin for ordination plotting with Emperor.
  feature-classifier  Plugin for taxonomic classification.
  feature-table       Plugin for working with sample by feature tables.
  fragment-insertion  Plugin for extending phylogenies.
  gneiss              Plugin for building compositional models.
  longitudinal        Plugin for paired sample and time series analyses.
  metadata            Plugin for working with Metadata.
  phylogeny           Plugin for generating and manipulating phylogenies.
  quality-control     Plugin for quality control of feature and sequence data.
  quality-filter      Plugin for PHRED-based filtering and trimming.
  sample-classifier   Plugin for machine learning prediction of sample
                      metadata.

  taxa                Plugin for working with feature taxonomy annotations.
  vsearch             Plugin for clustering and dereplicating with vsearch.

Back to Top

Installation

source code from QIIME2

System

64-bit Linux