CUBIC Wiki

User Tools

Site Tools

Trace:
software-list

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
software-list [2023/04/05 11:38] – joebatheltsoftware-list [2023/04/21 09:45] (current) – jonas
Line 17: Line 17:
  
 ===== Containerised environments ===== ===== Containerised environments =====
 +
 +[Contributed by Joe Bathelt]
  
 Let's dive into the fascinating world of containers! Are you tired of dealing with version conflicts and complicated installations of different software packages on your high-performance computer cluster (HPC)? Say no more! Containers provide an easy and self-contained environment for your analysis. They allow you to use any software without the need for systems administrators to install it on the HPC. With containers, you can run complex data analyses on large datasets that would take weeks on a desktop computer, in just a matter of hours! Let's dive into the fascinating world of containers! Are you tired of dealing with version conflicts and complicated installations of different software packages on your high-performance computer cluster (HPC)? Say no more! Containers provide an easy and self-contained environment for your analysis. They allow you to use any software without the need for systems administrators to install it on the HPC. With containers, you can run complex data analyses on large datasets that would take weeks on a desktop computer, in just a matter of hours!
Line 24: Line 26:
 You might have heard of Docker, which is a popular container environment software that is easy to install and widely used in software development and science. But have you heard of Singularity? It's also a container environment software developed specifically for HPCs. And the best part? You don't need admin rights to run it! You might have heard of Docker, which is a popular container environment software that is easy to install and widely used in software development and science. But have you heard of Singularity? It's also a container environment software developed specifically for HPCs. And the best part? You don't need admin rights to run it!
  
-If you're not sure which container to use for your analysis, don't worry! There are already many fully developed and tested pipelines available, such as //fmriprep// [[https://fmriprep.org/en/stable/]], which is a fully-fledged pipeline for processing functional MRI data. You can find other containerised pipelines on NiPreps [[https://www.nipreps.org]], Google, or by reading through recent publications in //NeuroImage// or //Human Brain Mapping//.+If you're not sure which container to use for your analysis, don't worry! There are already many fully developed and tested pipelines available, such as //fmriprep// [[https://fmriprep.org/en/stable/]], which is a widely used pipeline for processing functional MRI data. You can find other containerised pipelines on [[https://www.nipreps.org]], Google, or by reading through recent publications in //NeuroImage// or //Human Brain Mapping//.
  
 Most containerised pipelines were implemented in Docker. To run it on the cluster with Singularity, you will need to convert it. Here is an example of how to do this for //fmriprep// (thanks to Carl Hodgetts for testing this out): Most containerised pipelines were implemented in Docker. To run it on the cluster with Singularity, you will need to convert it. Here is an example of how to do this for //fmriprep// (thanks to Carl Hodgetts for testing this out):
Line 45: Line 47:
 Check the //fmriprep// documentation for additional configuration options: [[https://fmriprep.org/en/1.5.9/singularity.html]] Check the //fmriprep// documentation for additional configuration options: [[https://fmriprep.org/en/1.5.9/singularity.html]]
  
 +==== Making your own container ====
  
-You want to use your own analysis pipeline, I hear you say. No problem, it's easy with neurodocker [[https://www.repronim.org/neurodocker/index.html]]! It generates a file containing all the required software information for your container. Once you have your file, you can build your container and transfer it to the cluster to run your analysis. +You want to use your own analysis pipeline, I hear you say. No problem, it's easy with neurodocker! It generates a file containing all the required software information for your container. Once you have your file, you can build your container and transfer it to the cluster to run your analysis. More info here: [[https://www.repronim.org/neurodocker/index.html]] 
  
 Generate the "recipe" file: Generate the "recipe" file:
Line 69: Line 72:
  
  
-Please note that you need admin rights to build the container. This cannot be done by regular users on the HPC. If you have a Mac or Windows PC, you can install a virtual machine with Linux and build the container there. Ensure that your local version of Singularity is the same as the one on the cluster, i.e. Version 2.6+Please note that you need admin rights to build the container. This cannot be done by regular users on the HPC; please contact Steve Hammett or Jonas Larsson for assistance. If you have a Mac or Windows PC, you can install a virtual machine with Linux and build the container there. Ensure that your local version of Singularity is the same as the one on the cluster, i.e. Version 2.6 
 + 
 +==== Using your Singularity container ====
  
-**Using your singularity image**: 
 There are different ways to use your singularity container. I divided this by use case here: There are different ways to use your singularity container. I divided this by use case here:
  
software-list.1680694685.txt.gz · Last modified: 2023/04/05 11:38 by joebathelt
Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki