Difficulty: Medium Tags: Language Models, Cross-Entropy, Perplexity
A language-model evaluation dashboard reports perplexity from token-level negative log likelihoods. It accidentally exponentiates the sum rather than the mean, causing scores to depend exponentially on evaluation-set length.
Given token negative log-likelihoods l_1, ..., l_N (already token-level
negative log likelihoods):
H = mean(l)
PPL = e^H
losses: a list of N non-negative loss values.
(mean_loss, perplexity), 6 decimal places.
1 <= N <= 10^5, 0 <= l_i <= 20.Input
losses = [0.5, 1.0, 1.5]
Output
1.000000 2.718282
Explanation: The mean loss is 1, so perplexity is e^1.
No results yet
Run your code to check it against the examples, or submit to run every test.