Tag: Benchmark
All the articles with the tag "Benchmark".
-
Wrong, but 90% confident
I tried Laya, the open-source reproduction of TypeSafe's Jev, on my Obsidian plugin's duplicate-note decisions (Jev itself only through its docs, since my account isn't open yet). I measured CPU speed, 78% accuracy, and what fine-tuning would take, and the real problem turned out to be broken calibration: confidence around 0.9 on wrong answers.