Sep 25 – 26, 2024
ONLINE
Europe/Vienna timezone
Please note, the course date had to be shifted to 25–26 September 2024.

Agenda & Content

Day 1     Wednesday, 25 September 2024

08:45  Join in
09:00Welcome, Motivation & Introduction
=====Introduction to LLMs
09:15Overview
09:45Huggingface Ecosystem
10:00Transformer Anatomy
10:15Tokenization & Embeddings
10:30-- BREAK --
10:45Hands-on example
=====Memory-efficient Training
11:15Quantization
11:30PEFT
11:45unsloth
12:00Hands-on example
12:30Q & A
13:00End of day 1

 

Day 2     Thursday, 26 September 2024

08:45  Join in
09:00Recap
=====Distributed Training
09:30Huggingface Accelerate
10:00Hands-on example
10:30-- BREAK --
10:45ZeRO, FSDP & DeepSpeed
11:15Hands-on example
=====Evaluation
11:45Methods & Metrics
12:00Monitoring
12:15Inference
12:30Hands-on example
12:50Wrap-up
13:00End of day 2