Luong Attention: The Local Window
Beginner
The problem, from first principles
Local attention (Luong et al., 2015) looks only at a window of source positions around a predicted alignment point. It is cheaper than attending to the whole sentence, and the window keeps the search focused.
From theory to code
Implement local_window(center, D, T), returning the window of source positions to attend to.
Constraints
- Clip the window to the valid range 0 to T.
Hints
Hint 1
Take the window from center minus D to center plus D inclusive, then clamp both ends to the sentence.
Keywords
research-paperssequence-modelsattentiontranslation
Python
Run your code to see results
No results yet
Run your code to check it against the examples, or submit to run every test.