Online Course on Introduction to High Performance Computing (HPC) and Parallel Programming (3:1)

Objectives

The objective of the course is to make working professionals, and graduate students acquaint themselves with parallel Programming and High-Performance Computing (HPC) terminology and concepts. Explain the ways in which parallelization can enable high performance computing. Make familiar with the issues involved in developing a parallel application and to decide on an approach for developing a parallel version of the application.

Syllabus

• Why HPC?
• Profiler: NVPROF, GPROF (GNU GCC Profiling Tool)
• OpenMP: MPMD model, Fork joins model, Thread scheduling, Load Balancing, Sync and critical section
• Distributed Computing MPI: Multi-processing computing, Message Passing Basics, Collectives.
• Accelerated Computing (GPU): GPU Programming, OpenACC
• Hybrid programming

Target Group

DRDO, ISRO, Corporate employees or fresh graduates interested in computational science.

Who Can apply?

BE/B.Tech with basic knowledge of Computer Programming

Pre-requisites

Familiarity with programming in C/Fortran/C++/Python using editors or IDE’s

Reference Books

1. Parallel Programming. Techniques and Applications Using Networked Workstations and Parallel Computers by Barry Wilkinson and Michael Allen, Pearson Prentice Hall, second edition, 2005.
2. Programming Massively Parallel Processors. A Hands-on Approach by David B. Kirk and Wen-mei W. Hwu, Elsevier/Morgan Kaufmann Publishers, 2010; second edition, 2013.
3. Introduction to Parallel Computing by Ananth Grama, Anshul Gupta, George Karypis, Vipin Kumar Publisher: Addison Wesley; (2003) ISBN: 0-201-64865-2
4. MPI: The Complete Reference. Available Online.