Self-Consistency: Agreement Rate
Beginner
The problem, from first principles
The agreement rate measures how confident the sampled reasoning is. When most paths reach the same answer, the vote is reliable; when they scatter, the model is unsure.
From theory to code
Implement agreement_rate(answers), the share of answers that match the majority.
Constraints
- The list is non-empty.
Hints
Hint 1
Count the answers, take the largest count, and divide by the total.
Keywords
research-papersagentsreasoningsampling
Python
Run your code to see results
No results yet
Run your code to check it against the examples, or submit to run every test.