NUS Information Technology Internship (ATAP 2023)

Completed an internship at NUS Information Technology (May to Oct 2023). Worked on the Multi-Cloud Workload Bursting for Research Computing project described below: NUS IT’s Research Computing team manages a central pool of high-performance computing, artificial intelligence and machine learning (HPC/AI/ML) resources, both on-premises in our NUS data centre, and in the cloud. The resources are open to all NUS staff and students. The objective of this project is to explore innovative ways of auto-bursting HPC/AI/ML workloads into the cloud, in a secure, seamless and cost-efficient manner. Over the course of the internship, the intern has: - Worked together with the Research Computing team to brainstorm, explore and implement innovative ways of launching HPC/AI/ML jobs to the cloud, making use of the on-premises job scheduler. The tasks include the identification of jobs suitable to be launched to the cloud, data preparation, setting up of cloud environment, launching the job and post-mortem operations, clean-up activities and reporting. - Acquired hands-on experience in Linux batch scheduling, leveraging cloud technologies such as Terraform and Puppet.