National Center for Supercomputing Applications WordPress Master Calendar

View Full Calendar

NCSA staff who would like to submit an item for the calendar can email

HAL Training: Introduction to Transformer models

Event Type
Center for Artificial Intelligence Innovation
wifi event
Apr 12, 2023   3:00 - 5:00 pm  
Priyam Mazumdar - MS student
Originating Calendar
Center for Artificial Intelligence Innovation

Center for Artificial Intelligence Innovation at NCSA is organizing online training sessions throughout the Spring 2023 semester to help users to get started with deep learning projects on HAL. These sessions are designed for novice users to learn about the system and start building deep neural network models. To sign up for training, just request a HAL account prior to the training session and mention "spring training" when describing how the system will be used in your project. Trainings will take place every Wednesday during the fall semester from 3-5pm via Zoom. 

Training Link:

April 12, 2023: HAL Training: Introduction to Transformer models

Training Overview: 
In this tutorial, you'll gain an understanding how to developing and training Transformer models. We'll compare with Sequence models and explore how to construct and utilize a Vision Transformer. You'll learn about essential components such as PatchEmbeddings, Attention Layers, Class tokens, and Positional Embeddings, which play crucial roles in the architecture of the Transformer. By the end of this tutorial, you'll have a foundation to build and train your Transformer models effectively. 

Sessions will be recorded and available on the CAII website after the training. 

link for robots only