Basic GenAI concepts · Question 6 of 12
Which architecture are most large language models based on?
1 answer is correct. Easy
Show answer
Answer
- A Transformer
Explanation
Transformers process sequences with the self-attention mechanism, which weights the relationships between all tokens of an input. They can be trained efficiently in parallel and form the basis of practically all modern LLMs.