Skill · Applied AI · Understand, serve and integrate language models
Run and serve an open source LLM, from the workstation to the GPU
Run an open source LLM on your workstation with Ollama, serve it as an API with llama.cpp or Transformers, and quantize it to fit in memory.
Start lesson 1The Applied AI domain
- 7 lessons
- ~5 h 45 of reading
- 7 quizzes
- 0 proof lab
The path
Where it comes from, where it leads
What you need to know first, where you stand on this skill, and what it opens next. Your status is computed in your browser, from what you have read and passed.
Before · 2 prerequisites
Recommended before · 1
This skill, for you
Run and serve an open source LLM, from the workstation to the GPU
Computing
It unlocks · nothing yet
No other skill requires it: it is an end-of-path skill.
The path through the foundations From the most upstream foundation to this skill: what is in place, what remains to read.
Lessons
How to learn it
7 lessons, about ~5 h 45, in program order. Each lesson ends with its quiz.
The program
7 lessons · ~5 h 45
- 1Quantifier un LLM en pratique (in French)· 50 min
- 2Ollama: run LLMs locally on your own PC· 65 min
- 3Ollama : dépannage et configuration (in French)· 35 min
- 4llama.cpp : serveur d'inférence (in French)· 40 min
- 5Hugging Face Transformers (in French)· 65 min
- 6vLLM : haute performance (in French)· 45 min
- 7SGLang : RadixAttention (in French)· 45 min
Beyond the lessons
Assess, practise, pass the proof
Reading a lesson confirms nothing. A skill is confirmed by a passed quiz, practised in a guided lab, and put to the test by a challenge or a mission; an imported lab result is not verified by the site.
Assess yourself
7 quizzes
At the end of the lessons: passed at 70%, they confirm the skill.
Practice
No guided lab
No guided lab practices it yet.
Proof
No proof
Neither a challenge nor a mission with a proof yet.
Placement test
Preparing the questions…
Your answers in detail
For each question asked: your answer, the correct answer, its explanation and the page to reread.
Around it
Who requires it, who teaches it
Required by
Taught by
Same block · Understand, serve and integrate language models