Grouped-Query Attention: Valid Group Counts
Beginner
The problem, from first principles
Grouped-query attention only works when the query heads divide evenly into groups. Checking that before building a model prevents a silent mismatch between head counts and cache shapes.
From theory to code
Implement groups_valid(n_heads, n_kv), returning whether the grouping is well defined.
Constraints
- Returns a bool.
Hints
Hint 1
Check the group count is between one and the head count and divides it exactly.
Keywords
research-paperssystemsattentioninference
Python
Run your code to see results
No results yet
Run your code to check it against the examples, or submit to run every test.