Technology and operation · Question 16 of 60
What does quantization mean in the context of ML hardware?
1 answer is correct. Easy
Show answer
Answer
- A Low-precision arithmetic, i.e. computing with fewer bits (e.g. 4 instead of 32 bits)
Explanation
With quantization, a model uses fewer bits per number, for example 4 instead of 32. The results become slightly less exact, but the computation runs faster, needs less power and memory bandwidth, and fits on smaller, cheaper chips.