Encyclopedia · Free preview
Scoreboard Hijack
Compare the rewarded proxy metric against an independent measure of the real outcome.
Your Italian streak on the language app hits 400 days and your friends are impressed. Then an actual Italian waiter asks you a question in Rome and you freeze completely. The app's numbers have been climbing for over a year. Your ability to hold a conversation, the thing the numbers were supposed to represent, apparently has not.
Scoreboard Hijack, as a quick check, means comparing the rewarded proxy metric against an independent measure of the real outcome. The cue is any number you are optimizing that stands in for something you actually want: streaks for fluency, steps for fitness, emails sent for pipeline. The operation: name the proxy, name the real outcome in plain words, then find one measurement of the outcome that does not flow through the proxy system at all, such as a five-minute conversation with a native speaker. If proxy and reality have diverged, your effort has been quietly redirected toward what gets scored, and the fix is to change what you practice or what you count. What changes is that improvement lands where you meant it to. Do not run the check obsessively on a proxy that is young and cheap; some divergence takes time, and constant auditing kills the habit the proxy was built to sustain.
Keep exploring
Read the full page.
Create your free access to continue reading and explore the complete library.
Register free with ChatGPT →Already registered? Use the same button to sign in.
Sign-in shares your email with Michael Simmons to create your site access. No payment required. Newsletter signup is separate. How your data is used