Toolformer: Keeping Useful Calls
Intermediate
The problem, from first principles
Toolformer keeps an inserted call only if it helps. The model's loss on the following words is computed with and without the call and its result, and the call survives only if the loss drops by a margin tau.
From theory to code
Implement keep_call(loss_without, loss_with, tau), returning whether the call is kept.
Constraints
- Returns a bool; the threshold is inclusive.
Hints
Hint 1
Compute the reduction loss_without - loss_with and compare it with tau.
Keywords
research-papersagentstool-usetoolformer
Python
Run your code to see results
No results yet
Run your code to check it against the examples, or submit to run every test.