viva — human adjudications (2026-04-21)
run run_2d9dbf859a9e0ebf · model_comparison
12/10
cases completed
—
accuracy (ground-truth subset)
$0.0187
total cost
2430ms
avg latency
Claude Sonnet 4.5
anthropic · claude-sonnet-4-5-20250929
Model comparison
Per-case results (12)
Each row is one case judged by this run's model.
| Case | Expected | Agent | Match | Cost | Latency |
|---|---|---|---|---|---|
chatgpt · Voyoger Coffee Mate · best-reviewed coffee shop in the Cupertino area | NO⚠ | NO | ✓ | $0.001545 | 2339ms |
chatgpt · Voyoger Coffee Mate · I’m looking for a cozy coffee shop with Wi-Fi in C | NO⚠ | NO | ✓ | $0.001557 | 2172ms |
chatgpt · Voyoger Coffee Mate · alternatives to Peet's Coffee in Cupertino, CA | NO⚠ | NO | ✓ | $0.001626 | 2937ms |
chatgpt · Voyoger Coffee Mate · are there any vegan options at coffee shops in Cup | NO⚠ | NO | ✓ | $0.001500 | 2143ms |
chatgpt · Voyoger Coffee Mate · most reliable coffee shops in Cupertino, CA | NO⚠ | NO | ✓ | $0.001422 | 4403ms |
chatgpt · Voyoger Coffee Mate · what’s the price range for specialty coffee in the | NO⚠ | NO | ✓ | $0.001599 | 2444ms |
chatgpt · Voyoger Coffee Mate · I need a quiet place for studying, what kind of co | NO⚠ | NO | ✓ | $0.001446 | 1481ms |
chatgpt · Voyoger Coffee Mate · what are the best coffee shops compared to Starbuc | NO⚠ | NO | ✓ | $0.001500 | 1910ms |
chatgpt · Voyoger Coffee Mate · Voyoger Coffee Mate reviews | NO⚠ | NO | ✓ | $0.001602 | 2480ms |
chatgpt · Voyoger Coffee Mate · how much does a latte cost in Cupertino, CA? | NO⚠ | NO | ✓ | $0.001710 | 2397ms |
chatgpt · Voyoger Coffee Mate · find me a good coffee shop near me in Cupertino | NO⚠ | NO | ✓ | $0.001593 | 2208ms |
chatgpt · Voyoger Coffee Mate · who does coffee in Cupertino, CA | NO⚠ | NO | ✓ | $0.001551 | 2250ms |