| Start date: | 3 July 2024, 09:00 (CEST) | Entry level: | Intermediate | |
| End date: | 4 July 2024, 13:00 (CEST) | Subject area: | Artificial Intelligence | |
| Location: | ONLINE (Zoom) | Topics: | Large Language Models | |
| Language: | English | Target audience: | Academia, industry, public sector | |
| Price: | Free (for eligible participants) | Organizers: | VSC & EuroCC Austria |
Overview
During the last three years, interest in Large Language Models (LLMs) has experienced a meteoric rise, leaving virtually no domain untouched. The complexity of the models themselves, however, has increased to such an extent, that access to powerful computing resources has become a requirement for anyone wanting to develop products with this novel approach.
In this intensive two half-day course, participants will dive into the world of LLMs and their development on supercomputers. From covering the fundamentals to hands-on implementations, this course offers a comprehensive exploration of LLMs, including cutting-edge techniques and tools such as parameter-efficient fine-tuning (PEFT), quantization, zero redundancy optimizers (ZeRO), fully sharded data parallelism (FSDP), DeepSpeed, and Huggingface accelerate.
By the end of this course, participants will have gained the understanding, knowledge and practical skills to develop LLMs effectively on supercomputers, empowering them to tackle challenging natural language processing tasks across various domains.
Agenda & Content
See Agenda & Content in the left menu for a detailed timetable and course content.
Entry level
Intermediate
Prerequisites
Basic programming skills in Python.
Having worked with Pytorch would be beneficial. We will offer a quick intro to Pytorch in form of a Jupyter notebook in a pre-assignment.
Target audience
Course for academia, industry, and public administration.
Course format
This course will be delivered as a LIVE ONLINE COURSE (using Zoom).
Hands-on labs
All participants will get a temporary user account on VSC to do the hands-on labs.
You will use your own laptop or workstation to connect conveniently from your browser to the VSC Jupyterhub and do the hands-on exercises.
Accepted participants will be contacted a few days before the course and asked to do a short PRE-ASSIGNMENT that has to be completed before the course starts.
Lecturers
Simeon Harrison (VSC Research Center, TU Wien and EuroCC Austria)
Language
English
Date, time, and location
03.-04.07.2024, 09:00 – 13:00 CEST, LIVE ONLINE COURSE (using Zoom)
Prices and eligibility
This course is partly funded by the EuroCC 2 project. Therefore, the course is open and free of charge for participants from academia, industry, and public administration from the Member States (MS) of the European Union (EU) and Associated/Other Countries to the Horizon 2020 programme.
Registration
The registration form and deadlines are available from the left menu. The registration form might close even before the deadline if the number of registrations has reached its maximum (and will open again if there are cancelations).
Please register with your official email address to prove your affiliation.
You will get an automatic confirmation via email (subject starting with "[Indico] Registration"), please check your Spam/Junk folders.
Following your successful registration, you will receive further information approximately 1 week before the course.
Waitinglist
After the number of registrations has reached its maximum or the registration form has been closed, you may want to send us an email stating that you are interested to be put on the waiting list (vacancies may occur due to cancelations, etc.).
To be able to do the hands-on labs on the VSC please provide your full international mobile-phone number for the two-factor authentication required to login to the VSC systems.
Modification, withdrawal & no-show policy
Your registration is binding. Please only register for the course if you are really going to attend.
You can update your registration data or withdraw your registration anytime before the registration form has been closed via the link "Manage my registration" which you can find at the bottom of your automatic email confirmation (subject starting with "[Indico] Registration").
Alternatively, or after the registration form has been closed, please inform us about your cancelation or any change in your registration data (especially your mobile-phone number) via email (training@vsc.ac.at).
No-show policy: If you do not cancel and do not show up at the course you will be blacklisted and excluded from future training events.
Organizers
This course is jointly organized by the VSC Research Center, TU Wien, and EuroCC Austria.
Acknowledgements
This course is partially funded by the EuroCC 2 project.
The project has received funding from the European High-Performance Computing Joint Undertaking (JU) under grant agreement No 101101903. The JU receives support from the Digital Europe Programme and Austria, Belgium, Bulgaria, Croatia, Cyprus, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Montenegro, Netherlands, North Macedonia, Norway, Poland, Portugal, Romania, Serbia, Slovakia, Slovenia, Spain, Sweden, and Türkiye.
Additional funding for the project comes from the Austrian federal ministries BMBWF and BMK.
