Center for Artificial Intelligence Innovation at NCSA is organizing online training sessions throughout the Spring 2023 semester to help users to get started with deep learning projects on HAL. These sessions are designed for novice users to learn about the system and start building deep neural network models. To sign up for training, just request a HAL account prior to the training session and mention "spring training" when describing how the system will be used in your project. Trainings will take place every Wednesday during the fall semester from 3-5pm via Zoom.
Training Link: https://go.ncsa.illinois.edu/CAIIHALTraining
April 12, 2023: HAL Training: Introduction to Transformer models
Training Overview: In this tutorial, you'll gain an understanding how to developing and training Transformer models. We'll compare with Sequence models and explore how to construct and utilize a Vision Transformer. You'll learn about essential components such as PatchEmbeddings, Attention Layers, Class tokens, and Positional Embeddings, which play crucial roles in the architecture of the Transformer. By the end of this tutorial, you'll have a foundation to build and train your Transformer models effectively.
Sessions will be recorded and available on the CAII website after the training.