AWS ParallelCluster 3.2: file system enhancements and other top requested features

AWS ParallelCluster 3.2 release is now generally available. AWS ParallelCluster is a fully supported and maintained open source cluster management tool that makes it easy for scientists, researchers, and IT administrators to deploy and manage High Performance Computing (HPC) clusters in the AWS cloud. HPC clusters are collections of tightly coupled compute, storage, and networking resources that enable customers to run large scale scientific and engineering workloads.

Significant feature enhancements in AWS ParallelCluster 3.2 include:

1. Multiple file systems mounts. Customers can now mount up to 20 Amazon FSx and 20 Amazon EFS existing file systems to a single cluster.
2. Support for additional Amazon FSx file systems. Customers can now mount existing Amazon FSx for OpenZFS, Amazon FSx for NetApp ONTAP, and Amazon FSx for Lustre Persistent_2 file systems to your cluster. The ParallelCluster cluster configuration file now provides additional sections to configure these file systems.
3. Memory-aware job scheduling with Slurm. Customers can now leverage Slurm’s memory-based scheduling functionality to specify memory requirements on job submission, and control placement of compute instances that match those memory requirements.
4. Extending flexibility to dynamically update clusters. Customers can now dynamically update job queue properties such as AMI without having to stop and start their clusters. For example, through a simple CLI command, you can hot swap an AMI while controlling the cycling of compute nodes.

AWS ParallelCluster is available at no additional cost, and you pay only for the AWS resources needed to run your applications. Learn how to launch an HPC cluster using AWS ParallelCluster here.

For more detail you can find the complete release notes for the latest version of AWS ParallelCluster here.