Before combining with V, the advantages are centered so they have zero mean across actions. This is the piece that pins down the value and advantage streams.
Implement centered_advantage(A), subtracting the mean of the advantage vector.
Subtract A.mean() from every entry.
No results yet
Run your code to check it against the examples, or submit to run every test.