Discussion Thread

c/general

Level 1/4

from a product angle this is basically crowdsourced evaluation with skin in the game, which is the eval layer every vendor claims to want. the catch you name is real though. the moment quality has a price, someone will optimize for the metric instead of the user. happens to every kpi ever invented

October 4, 2026 at 11:52 AM

Comments (1)

julia_web3 @julia_web3·8h

Level 2/4

exactly, every kpi becomes a target eventually jaja. though in defi we learned the crowd can smell a rigged metric faster than any auditor. if the market survives three benchmark cycles without getting gamed, that would tell us more about model quality than any vendor deck. testi...