viva — human adjudications (2026-04-21)
run run_1e1e3fe5d8d65153 · model_comparison
31/10
cases completed
—
accuracy (ground-truth subset)
$0.0273
total cost
895ms
avg latency
GPT-4o
openai · gpt-4o
Model comparison
Per-case results (31)
Each row is one case judged by this run's model.
| Case | Expected | Agent | Match | Cost | Latency |
|---|---|---|---|---|---|
chatgpt · Voyoger Coffee Mate · best-reviewed coffee shop in the Cupertino area | NO⚠ | NO | ✓ | $0.000868 | 1861ms |
chatgpt · Voyoger Coffee Mate · I’m looking for a cozy coffee shop with Wi-Fi in C | NO⚠ | NO | ✓ | $0.000908 | 617ms |
chatgpt · Voyoger Coffee Mate · alternatives to Peet's Coffee in Cupertino, CA | NO⚠ | NO | ✓ | $0.000887 | 798ms |
chatgpt · Voyoger Coffee Mate · are there any vegan options at coffee shops in Cup | NO⚠ | NO | ✓ | $0.000898 | 1804ms |
chatgpt · Voyoger Coffee Mate · most reliable coffee shops in Cupertino, CA | NO⚠ | NO | ✓ | $0.000878 | 543ms |
chatgpt · Voyoger Coffee Mate · what’s the price range for specialty coffee in the | NO⚠ | NO | ✓ | $0.000890 | 705ms |
chatgpt · Voyoger Coffee Mate · I need a quiet place for studying, what kind of co | NO⚠ | NO | ✓ | $0.000905 | 494ms |
chatgpt · Voyoger Coffee Mate · what are the best coffee shops compared to Starbuc | NO⚠ | NO | ✓ | $0.000873 | 725ms |
chatgpt · Voyoger Coffee Mate · Voyoger Coffee Mate reviews | NO⚠ | YES | ✗ | $0.000860 | 674ms |
chatgpt · Voyoger Coffee Mate · how much does a latte cost in Cupertino, CA? | NO⚠ | NO | ✓ | $0.000893 | 619ms |
chatgpt · Voyoger Coffee Mate · find me a good coffee shop near me in Cupertino | NO⚠ | NO | ✓ | $0.000888 | 858ms |
chatgpt · Voyoger Coffee Mate · who does coffee in Cupertino, CA | NO⚠ | NO | ✓ | $0.000873 | 774ms |
chatgpt · Best Physical Theraphy · Looking for a nutritionist near me in Cupertino, C | NO⚠ | NO | ✓ | $0.000955 | 1092ms |
chatgpt · Best Physical Theraphy · Best Physical Therapy reviews in Cupertino, CA. | NO⚠ | NO | ✓ | $0.000905 | 912ms |
chatgpt · Best Physical Theraphy · Can you help me find fitness centers with the best | NO⚠ | NO | ✓ | $0.000908 | 507ms |
chatgpt · Best Physical Theraphy · What's the most reliable chiropractor in Cupertino | NO⚠ | NO | ✓ | $0.000868 | 612ms |
chatgpt · Best Physical Theraphy · Alternatives to big chain gyms in Cupertino, CA? | NO⚠ | NO | ✓ | $0.000885 | 484ms |
chatgpt · Best Physical Theraphy · What are the best physical therapy services compar | YES⚠ | YES | ✓ | $0.000883 | 967ms |
chatgpt · Best Physical Theraphy · My gym needs more equipment, what should I look fo | NO⚠ | NO | ✓ | $0.000917 | 766ms |
chatgpt · Best Physical Theraphy · I need post-surgery rehabilitation because I just | NO⚠ | NO | ✓ | $0.000888 | 587ms |
chatgpt · Best Physical Theraphy · How much does a massage cost in Cupertino, CA? | NO⚠ | NO | ✓ | $0.000910 | 962ms |
chatgpt · Best Physical Theraphy · What’s the pricing for yoga classes in the Cuperti | NO⚠ | NO | ✓ | $0.000900 | 493ms |
chatgpt · Best Physical Theraphy · Can you find me a personal trainer near Cupertino? | NO⚠ | NO | ✓ | $0.000888 | 673ms |
chatgpt · Best Physical Theraphy · Who does physical therapy in Cupertino, CA? | NO⚠ | NO | ✓ | $0.000910 | 4038ms |
chatgpt · Coca Cola Company · best brands of soft drinks compared to Coca Cola | YES⚠ | YES | ✓ | $0.000873 | 767ms |
chatgpt · Coca Cola Company · Coca Cola Company reviews | YES⚠ | YES | ✓ | $0.000875 | 668ms |
chatgpt · Coca Cola Company · most reliable catering companies in my town | NO⚠ | NO | ✓ | $0.000825 | 565ms |
chatgpt · Coca Cola Company · food delivery services with the best reviews in my | NO⚠ | NO | ✓ | $0.000838 | 480ms |
chatgpt · Coca Cola Company · my office needs lunch catering, what should I look | NO⚠ | NO | ✓ | $0.000835 | 772ms |
chatgpt · Coca Cola Company · I need a restaurant delivery service because I’m h | NO⚠ | NO | ✓ | $0.000840 | 636ms |
chatgpt · Coca Cola Company · what's the best local food truck compared to big n | NO⚠ | NO | ✓ | $0.000820 | 1288ms |