Bactopia Tool - `midas`¶

The midas module uses MIDAS to estimate the abundance of bacterial species in a sample. MIDAS makes use of a database with more than 30,000 reference genomes to estimate abundances.

Example Usage¶

bactopia --wf midas \
  --bactopia /path/to/your/bactopia/results \ 
  --include includes.txt

Output Overview¶

Below is the default output structure for the midas tool. Where possible the file descriptions below were modified from a tools description.

<BACTOPIA_DIR>
├── <SAMPLE_NAME>
│   └── tools
│       └── midas
│           ├── <SAMPLE_NAME>.midas.abundances.txt
│           ├── <SAMPLE_NAME>.midas.adjusted.abundances.txt
│           ├── <SAMPLE_NAME>.midas.tsv
│           └── logs
│               ├── nf-midas.{begin,err,log,out,run,sh,trace}
│               └── versions.yml
└── bactopia-runs
    └── midas-<TIMESTAMP>
        ├── merged-results
        │   ├── logs
        │   │   └── midas-concat
        │   │       ├── nf-merged-results.{begin,err,log,out,run,sh,trace}
        │   │       └── versions.yml
        │   └── midas.tsv
        └── nf-reports
            ├── midas-dag.dot
            ├── midas-report.html
            ├── midas-timeline.html
            └── midas-trace.txt

Results¶

Merged Results¶

Below are results that are concatenated into a single file.

Filename	Description
midas.tsv	A summary of the MIDAS results for all samples

MIDAS¶

Below is a description of the per-sample results from MIDAS.

Filename	Description
<SAMPLE_NAME>.midas.abundances.txt	A TSV file containing the abundance of each bacterial species in the sample
<SAMPLE_NAME>.midas.adjusted.abundances.txt	A TSV file containing the abundance of each bacterial species in the sample (adjusted for unclassified reads)
<SAMPLE_NAME>.midas.tsv	A TSV file containing the abundance of each bacterial species in the sample

Audit Trail¶

Below are files that can assist you in understanding which parameters and program versions were used.

Logs¶

Each process that is executed will have a folder named logs. In this folder are helpful files for you to review if the need ever arises.

Extension	Description
.begin	An empty file used to designate the process started
.err	Contains STDERR outputs from the process
.log	Contains both STDERR and STDOUT outputs from the process
.out	Contains STDOUT outputs from the process
.run	The script Nextflow uses to stage/unstage files and queue processes based on given profile
.sh	The script executed by bash for the process
.trace	The Nextflow Trace report for the process
versions.yml	A YAML formatted file with program versions

Nextflow Reports¶

These Nextflow reports provide great a great summary of your run. These can be used to optimize resource usage and estimate expected costs if using cloud platforms.

Filename	Description
midas-dag.dot	The Nextflow DAG visualisation
midas-report.html	The Nextflow Execution Report
midas-timeline.html	The Nextflow Timeline Report
midas-trace.txt	The Nextflow Trace report

Program Versions¶

At the end of each run, each of the versions.yml files are merged into the files below.

Filename	Description
software_versions.yml	A complete list of programs and versions used by each process
software_versions_mqc.yml	A complete list of programs and versions formatted for MultiQC

Parameters¶

Required Parameters¶

Define where the pipeline should find input data and save output data.

Parameter	Description
`--bactopia`	The path to bactopia results to use as inputs Type: `string`

Filtering Parameters¶

Use these parameters to specify which samples to include or exclude.

Parameter	Description
`--include`	A text file containing sample names (one per line) to include from the analysis Type: `string`
`--exclude`	A text file containing sample names (one per line) to exclude from the analysis Type: `string`

MIDAS species Parameters¶

Parameter	Description
`--midas_db`	A single tarball or path to a MIDAS formatted database Type: `string`
`--midas_word_size`	Word size for BLAST search Type: `integer`, Default: `28`
`--midas_aln_cov`	Discard reads with alignment coverage < ALN_COV Type: `number`, Default: `0.75`
`--midas_opts`	Extra MIDAS options Type: `string`
`--midas_debug`	Keep all temporary files created by MIDAS Type: `boolean`

Optional Parameters¶

These optional parameters can be useful in certain settings.

Parameter	Description
`--outdir`	Base directory to write results to Type: `string`, Default: `./`
`--run_name`	Name of the directory to hold results Type: `string`, Default: `bactopia`
`--skip_compression`	Ouput files will not be compressed Type: `boolean`
`--datasets`	The path to cache datasets to Type: `string`
`--keep_all_files`	Keeps all analysis files created Type: `boolean`

Max Job Request Parameters¶

Set the top limit for requested resources for any single job.

Parameter	Description
`--max_retry`	Maximum times to retry a process before allowing it to fail. Type: `integer`, Default: `3`
`--max_cpus`	Maximum number of CPUs that can be requested for any single job. Type: `integer`, Default: `4`
`--max_memory`	Maximum amount of memory (in GB) that can be requested for any single job. Type: `integer`, Default: `32`
`--max_time`	Maximum amount of time (in minutes) that can be requested for any single job. Type: `integer`, Default: `120`
`--max_downloads`	Maximum number of samples to download at a time Type: `integer`, Default: `3`

Nextflow Configuration Parameters¶

Parameters to fine-tune your Nextflow setup.

Parameter	Description
`--nfconfig`	A Nextflow compatible config file for custom profiles, loaded last and will overwrite existing variables if set. Type: `string`
`--publish_dir_mode`	Method used to save pipeline results to output directory. Type: `string`, Default: `copy`
`--infodir`	Directory to keep pipeline Nextflow logs and reports. Type: `string`, Default: `${params.outdir}/pipeline_info`
`--force`	Nextflow will overwrite existing output files. Type: `boolean`
`--cleanup_workdir`	After Bactopia is successfully executed, the `work` directory will be deleted. Type: `boolean`

Nextflow Profile Parameters¶