Training foundation models · Question 9 of 12
Which mappings of goal and training method are appropriate?
3 answers are correct. Medium
Show answer
Answer
- B Learning a specialist language from many unlabelled texts – continued pre-training
- D Following instructions in a fixed format – instruction tuning
- E A smaller, faster model for one purpose – distillation
Explanation
Continued pre-training on domain texts conveys a field's language and knowledge, instruction tuning teaches following instructions, and distillation transfers capabilities to a smaller model. Basic language understanding comes from pre-training, and up-to-the-day data is better supplied via RAG.