viva — human adjudications (2026-04-21)
run run_5f6d411cfddd05bd · model_comparison
26/10
cases completed
—
accuracy (ground-truth subset)
$0.0140
total cost
1089ms
avg latency
Claude Haiku 4.5
anthropic · claude-haiku-4-5-20251001
Model comparison
Per-case results (26)
Each row is one case judged by this run's model.
| Case | Expected | Agent | Match | Cost | Latency |
|---|---|---|---|---|---|
chatgpt · Voyoger Coffee Mate · best-reviewed coffee shop in the Cupertino area | NO⚠ | NO | ✓ | $0.000550 | 1069ms |
chatgpt · Voyoger Coffee Mate · I’m looking for a cozy coffee shop with Wi-Fi in C | NO⚠ | NO | ✓ | $0.000539 | 897ms |
chatgpt · Voyoger Coffee Mate · alternatives to Peet's Coffee in Cupertino, CA | NO⚠ | NO | ✓ | $0.000562 | 1045ms |
chatgpt · Voyoger Coffee Mate · are there any vegan options at coffee shops in Cup | NO⚠ | NO | ✓ | $0.000525 | 3172ms |
chatgpt · Voyoger Coffee Mate · most reliable coffee shops in Cupertino, CA | NO⚠ | NO | ✓ | $0.000519 | 820ms |
chatgpt · Voyoger Coffee Mate · what’s the price range for specialty coffee in the | NO⚠ | NO | ✓ | $0.000578 | 992ms |
chatgpt · Voyoger Coffee Mate · I need a quiet place for studying, what kind of co | NO⚠ | NO | ✓ | $0.000512 | 780ms |
chatgpt · Voyoger Coffee Mate · what are the best coffee shops compared to Starbuc | NO⚠ | NO | ✓ | $0.000525 | 1030ms |
chatgpt · Voyoger Coffee Mate · Voyoger Coffee Mate reviews | NO⚠ | NO | ✓ | $0.000519 | 1443ms |
chatgpt · Voyoger Coffee Mate · how much does a latte cost in Cupertino, CA? | NO⚠ | NO | ✓ | $0.000555 | 871ms |
chatgpt · Voyoger Coffee Mate · find me a good coffee shop near me in Cupertino | NO⚠ | NO | ✓ | $0.000566 | 1029ms |
chatgpt · Voyoger Coffee Mate · who does coffee in Cupertino, CA | NO⚠ | NO | ✓ | $0.000527 | 841ms |
chatgpt · Best Physical Theraphy · Looking for a nutritionist near me in Cupertino, C | NO⚠ | NO | ✓ | $0.000554 | 1394ms |
chatgpt · Best Physical Theraphy · Best Physical Therapy reviews in Cupertino, CA. | NO⚠ | NO | ✓ | $0.000548 | 975ms |
chatgpt · Best Physical Theraphy · Can you help me find fitness centers with the best | NO⚠ | NO | ✓ | $0.000518 | 785ms |
chatgpt · Best Physical Theraphy · What's the most reliable chiropractor in Cupertino | NO⚠ | NO | ✓ | $0.000560 | 1123ms |
chatgpt · Best Physical Theraphy · Alternatives to big chain gyms in Cupertino, CA? | NO⚠ | NO | ✓ | $0.000507 | 758ms |
chatgpt · Best Physical Theraphy · What are the best physical therapy services compar | YES⚠ | YES | ✓ | $0.000532 | 1187ms |
chatgpt · Best Physical Theraphy · My gym needs more equipment, what should I look fo | NO⚠ | NO | ✓ | $0.000509 | 1011ms |
chatgpt · Best Physical Theraphy · I need post-surgery rehabilitation because I just | NO⚠ | NO | ✓ | $0.000554 | 821ms |
chatgpt · Best Physical Theraphy · How much does a massage cost in Cupertino, CA? | NO⚠ | NO | ✓ | $0.000568 | 934ms |
chatgpt · Best Physical Theraphy · What’s the pricing for yoga classes in the Cuperti | NO⚠ | NO | ✓ | $0.000558 | 1073ms |
chatgpt · Best Physical Theraphy · Can you find me a personal trainer near Cupertino? | NO⚠ | NO | ✓ | $0.000510 | 856ms |
chatgpt · Best Physical Theraphy · Who does physical therapy in Cupertino, CA? | NO⚠ | NO | ✓ | $0.000569 | 972ms |
chatgpt · Coca Cola Company · best brands of soft drinks compared to Coca Cola | YES⚠ | YES | ✓ | $0.000477 | 1076ms |
chatgpt · Coca Cola Company · Coca Cola Company reviews | YES⚠ | YES | ✓ | $0.000541 | 1366ms |