orbench

You can pick a model on a gut feeling, orbenchmark it. orbench is a desktop app that lets you benchmark LLMs on your own tasks, A public leaderboard ranks models on someone else's prompts. Production evals tell you the truth, but only after you've done all the work to implement the models. orbench is the step in between: bring your real tasks (csv or HF dataset), pick any models on OpenRouter, and let your own rubric grade every answer with an AI judge, a blind human review, or both.