Which storage option would be the optimal solution?
Amazon Elastic File System (Amazon EFS)
Amazon FSx for Lustre
Amazon EC2 instance store
Amazon Elastic Block Store (Amazon EBS) Provisioned IOPS SSD (io1)
Explanations:
Amazon EFS is suitable for shared storage but may not provide the necessary performance for HPC workloads.
Amazon FSx for Lustre is optimized for high performance computing and supports large data sets, making it ideal for this scenario.
Amazon EC2 instance store is ephemeral storage and not suitable for shared access or persistent storage in HPC environments.
While Amazon EBS Provisioned IOPS SSD offers high performance, it is block storage and does not provide the shared file system required for the workload.