Pointer Networks: The Pointer Distribution
Intermediate
The problem, from first principles
Pointer networks (Vinyals et al., 2015) output a position in the input rather than a word from a fixed vocabulary. The output is a softmax over the input positions, so the vocabulary can change with every input.
From theory to code
Implement pointer_distribution(scores), a stable softmax over the input positions.
Constraints
- The output sums to one.
Hints
Hint 1
Subtract the maximum score, exponentiate, and normalize.
Keywords
research-paperssequence-modelsattentionpointer
Python
Run your code to see results
No results yet
Run your code to check it against the examples, or submit to run every test.