Training foundation models · Question 4 of 12
What happens when a model is distilled?
1 answer is correct. Easy
Show answer
Answer
- C A small model learns from a large one
Explanation
In distillation a large teacher model produces answers that are used to train a smaller student model. The student model is cheaper and faster and often reaches similar quality for its purpose.