Highway Networks: Mixing Transform and Carry
Beginner
The problem, from first principles
Once you have a gate t, the layer's output must mix the transform h and the untouched input x. The highway paper writes this as a convex blend, which is what lets the network route signal straight through when that helps.
From theory to code
Implement highway_combine(x, h, t), which returns h * t + x * (1 - t).
Constraints
tis in[0, 1].
Hints
Hint 1
The gate weights the transform and 1 - t weights the carry path.
Keywords
research-papersarchitecturehighway
Python
Run your code to see results
No results yet
Run your code to check it against the examples, or submit to run every test.