Knowledge Base Resources

• ACESS HPC Workshop Series
• MPI Workshop
• OpenMP Workshop
• GPU Programming Using OpenACC
• Summer Boot Camp
• Big Data and Machine Learning

Monthly workshops sponsored by ACCESS on a variety of HPC topics organized by Pittsburgh Supercomputing Center (PSC). Each workshop will be telecast to multiple satellite sites and workshop materials are archived.

• Landing Page
• Pytorch Quickstart
• Pytorch Basics
• Pytorch GPU Support
• Regression and Classification with Fully Connected Neural Networks
• High Dimensional Data
• Datasets and data loading
• Building the network
• Computer Vision and Convolutional Neural Networks

This workshop series introduces the essential concepts in deep learning and walks through the common steps in a deep learning workflow from data loading and preprocessing to training and model evaluation. Throughout the sessions, students participate in writing and executing simple deep learning programs using Pytorch – a popular Python library for developing, training, and deploying deep learning models.

• Horovod

Horovod is a distributed deep learning training framework. Using horovod, a single-GPU training script can be scaled to train across many GPUs in parallel. The library supports popular deep learning framework such as TensorFlow, Keras, PyTorch, and Apache MXNet.

• Thrust tutorial from Nvidia
• Thrust documentation

Thrust is a CUDA library that optimizes parallelization on the GPU for you. The Thrust tutorial is great for beginners. The documentation is helpful for anyone using Thrust.

• DELTA Youtube Video

Introductory video about DELTA. Speaker Tim Boerner, Senior Assistant Director, NCSA

• Workshop Resources

4/5/25 - 4/6/25 The Duke IEEE Student Chapter is working with ACCESS to host a workshop on a introduction to supercomputing. All workshop resources are available on https://workshop.dukeieee.org/ Topics include: Here's a summarized list of topics for the event: Day 1: Saturday, April 5th Opening Remarks & ACCESS Overview (Including how to request compute usage with Jetstream 2) Tutorial 1: Introduction to Supercomputing Architecture, Linux, and Job Scheduling (SLURM) Tutorial 2: Containerized Large Language Model Inference and Finetuning Tutorial 3: Portable Code - Local Containers to HPC Scale Tutorial 4: ACCESS Pegasus - Serverless Data Processing Workflow in Jupyter Notebooks Networking & Hors D'oeuvres Day 2: Sunday, April 6th Tutorial 2: Deep Dive in AI Agents - "Building Superintelligence in 90 Minutes" by Harry Fazzone Tutorial 3: DASK - Python-based Distributed Computing Framework for HPC Tutorial 4: Basic Parallelism & MPI by Rebecca Hartman-Baker, PhD (NERSC) Closing Talk: Capt. Grace Hopper on Future Possibilities: Data, Hardware, Software, and People (Part One, 1982)

• GPU Acceleration in Python

This tutorial explains how to use Python for GPU acceleration with libraries like CuPy, PyOpenCL, and PyCUDA. It shows how these libraries can speed up tasks like array operations and matrix multiplication by using the GPU. Examples include replacing NumPy with CuPy for large datasets and using PyOpenCL or PyCUDA for more control with custom GPU kernels. It focuses on practical steps to integrate GPU acceleration into Python programs.

• ACES: Charliecloud Containers for Scientific Workflows (Video)
• ACES: Charliecloud Containers for Scientific Workflows (Slides)

This tutorial introduces the use of Containers using the Charliecloud software suite. This tutorial will provide participants with background and hands-on experience to use basic Charliecloud containers for HPC applications. We discuss what containers are, why they matter for HPC, and how they work. We'll give an overview of Charliecloud, the unprivileged container solution from Los Alamos National Laboratory's HPC Division. Students will learn how to build toy containers and containerize real HPC applications, and then run them on a cluster. Exercises are demonstrated using the ACES cluster, a composable accelerator testbed at Texas A&M University. Students with an allocation on the ACES cluster can follow along with the ACES-specific exercises.

• Introduction to Parallel Programming for GPUs with CUDA

This tutorial provides a comprehensive introduction to CUDA programming, focusing on essential concepts such as CUDA thread hierarchy, data parallel programming, host-device heterogeneous programming model, CUDA kernel syntax, GPU memory hierarchy, and memory optimization techniques like global memory coalescing and shared memory bank conflicts. Aimed at researchers, students, and practitioners, the tutorial equips participants with the skills needed to leverage GPU acceleration for scalable computation, particularly in the context of AI.

• Intro to OpenACC

Introduction to the basics of OpenACC.

• thrust_ex.txt

Some examples for writing Thrust code. To compile, download the CUDA compiler from NVIDIA. This code was tested with CUDA 9.2 but is likely compatible with other versions. Before compiling change extension from thrust_ex.txt to thrust_ex.cu. Any code on the device (GPU) that is run through a Thrust transform is automatically parallelized on the GPU. Host (CPU) code will not be. Thrust code can also be compiled to run on a CPU for practice.

• ACCESS KB Guide

Expanse at SDSC is a cluster designed by Dell and SDSC delivering 5.16 peak petaflops, and offers Composable Systems and Cloud Bursting. This documentation describes how to use the Expanse cluster with some specific information for people with ACCESS accounts.