https://youvenz.github.io/tags/hpc-clusters/Recent content in HPC Clusters on Rachid Youven ZeghlacheHugoen-usThu, 05 Mar 2026 00:00:00 +0000https://youvenz.github.io/blog/2026-03-05-singularityapptainer-local-to-cluster-workflow/Thu, 05 Mar 2026 00:00:00 +0000https://youvenz.github.io/blog/2026-03-05-singularityapptainer-local-to-cluster-workflow/<h1 id="pull-build-and-deploy-singularity-containers-from-local-machine-to-hpc-clusters">Pull, Build, and Deploy Singularity Containers from Local Machine to HPC Clusters</h1> <p>You&rsquo;ve got terabytes of data on your HPC cluster and a Python script that works on your laptop. But moving it to the cluster means wrestling with dependency conflicts, mysterious <code>ModuleNotFoundError</code> messages, and copying massive datasets you don&rsquo;t want to duplicate. You need a way to package your entire development environment—dependencies, libraries, Python versions—and run it anywhere without breaking it. That&rsquo;s where <strong>Singularity/Apptainer</strong> comes in.</p>https://youvenz.github.io/blog/2026-03-05-ssh-slurm-transfer-code-to-hpc-clusters/Thu, 05 Mar 2026 00:00:00 +0000https://youvenz.github.io/blog/2026-03-05-ssh-slurm-transfer-code-to-hpc-clusters/<h2 id="transfer-code-to-hpc-clusters-using-ssh-singularityapptainer--slurm">Transfer Code to HPC Clusters Using SSH, Singularity/Apptainer &amp; SLURM</h2> <p>You&rsquo;ve written working code on your laptop. Now you need to run it on your institution&rsquo;s HPC cluster with 100+ GPUs—but you&rsquo;re staring at a terminal with no idea how to get your files there, containerize your environment, or submit a job without breaking it.</p> <p>This is the moment most researchers feel lost.</p> <h2 id="the-hpc-stack-in-90-seconds">The HPC Stack in 90 Seconds</h2> <p><strong>High-performance computing (HPC) clusters</strong> are shared servers with massive CPU and GPU resources. To use them safely and reproducibly, you need three tools working together:</p>