Training foundation models · Question 3 of 12
What is continued pre-training?
1 answer is correct. Easy
Show answer
Answer
- D Further training with unlabelled domain texts
Explanation
Continued pre-training trains a model further with large amounts of unlabelled text from a domain such as medicine or law. It learns the terminology and knowledge. Question-answer pairs, by contrast, belong to fine-tuning.