Back to programming-model index

MODEL EVIDENCE / OpenRouter #22

Upstage: Solar Pro 4

The model identity, provider record, and independently verified benchmark results in one place. The number above is OpenRouter discovery order, not benchmark rank.

upstage/solar-pro4
Official source pendingComplete result
Fast numbersCaptured facts and latest status
OpenRouter feed rank
OpenRouter #22
Context
524288
Input
text
Output
text
Reasoning flag
Yes
Prompt price
$0.030 / 1M tokens
Completion price
$0.120 / 1M tokens
Latest run
2026-09-07T17:19:44.592026+00:00
View denominator
50

DEEP BENCHMARK

What the run established.

Counts stay visible for auditability. A score appears only when the Most Annoying 50-trap view satisfies the independent checks.

MOST ANNOYING BENCHMARK

41/ 50

Complete result, latest run · 41 verified mistakes · 9 clean results · 0 unresolved

Inspect run receipt
Packs & trend

Pack 1: 9 verified mistakes, 1 clean results, 0 unresolved; Pack 2: 8 verified mistakes, 2 clean results, 0 unresolved; Pack 3: 7 verified mistakes, 3 clean results, 0 unresolved; Pack 4: 9 verified mistakes, 1 clean results, 0 unresolved; Pack 5: 8 verified mistakes, 2 clean results, 0 unresolved

2026-08-31T21:35:59.284247+00:00: 42; 2026-09-01T22:50:04.330589+00:00: 45; 2026-09-02T10:43:22.086711+00:00: not_run; 2026-09-03T18:44:32.089955+00:00: not_run; 2026-09-07T17:19:44.592026+00:00: 41

Score history

Model runs, then future slots.

  1. 0116%
  2. 0210%
  3. 03NOT RUN
  4. 04NOT RUN
  5. 0518%
  6. 06NOT RUN
  7. 07NOT RUN
  8. 08NOT RUN
  9. 09NOT RUN
  10. 10NOT RUN
  11. 11NOT RUN
  12. 12NOT RUN
  13. 13NOT RUN
  14. 14NOT RUN
  15. 15NOT RUN
  16. 16NOT RUN
  17. 17NOT RUN
  18. 18NOT RUN
  19. 19NOT RUN
  20. 20NOT RUN
  21. 21NOT RUN
  22. 22NOT RUN
  23. 23NOT RUN
  24. 24NOT RUN
Verified mistakesClean resultsUnresolved / pendingMissing / no recorded result

Most Annoying verified mistake receipts

Only receipts from the Most Annoying view are listed here. Tolerable-view receipts are separate and are not added to this score.

  1. Alias TraceT001

    The model's exact answer did not match the frozen expected output.

    sha256:d64551cb762a6841a8d9c467716d10ccb4f965c8a1f1866295a7f558d9b29593
  2. Precedence TraceT002

    The model's exact answer did not match the frozen expected output.

    sha256:1d92eb009ad5baf3e7bb936e15cf445d13389bbc718b3e9d3a9bae7d0a04f233
  3. Slice TraceT004

    The model's exact answer did not match the frozen expected output.

    sha256:8cb06b4478e301375248d6fe3214b1bd762c0827d8375b34d3896237b826f0e2
  4. Alias TraceT005

    The model's exact answer did not match the frozen expected output.

    sha256:a676f2cb4d3ebd2385de82de87d4502d63a1dba7e20b145630d7cddb6be97de9
  5. Precedence TraceT006

    The model's exact answer did not match the frozen expected output.

    sha256:3a772e55cb4c938740d3526d854639f77e75c5ada2f09d2ecaa8ea9d53f4a058
  6. Loop TraceT007

    The model's exact answer did not match the frozen expected output.

    sha256:507190116204b89f18ceaed60c1907d243f29b0202b459b9654fd5fdbc6dc0f8
  7. Slice TraceT008

    The model's exact answer did not match the frozen expected output.

    sha256:5d67b829dafbe82b587c04b0cf05df20a39eba86b723a84829311a7dfd6bcf41
  8. Alias TraceT009

    The model's exact answer did not match the frozen expected output.

    sha256:8ca019d3ccafbc7e0f66b450d08915d156e1f1cd182545b3ef6c364a65beacb4
  9. Precedence TraceT010

    The model's exact answer did not match the frozen expected output.

    sha256:09cf090675c6577d16bdcb22fe1dba010c77cc50904770e7f3ed1bd7ff4fc2e9
  10. Alias TraceT021

    The model's exact answer did not match the frozen expected output.

    sha256:cc20819e74730db4e720c0db7db3e5bb94bb1981a154aec0bb7d41fcfb9f2ca9
  11. Loop TraceT023

    The model's exact answer did not match the frozen expected output.

    sha256:8fb320453a2325a70ec73c9396e0f9a0aa542b7ef658a97ee1cc16c927c9de9f
  12. Slice TraceT024

    The model's exact answer did not match the frozen expected output.

    sha256:789d3e9078c78d4e3eb12b38477da8e84750af6ea51f526197334cb3faa2295f
  13. Alias TraceT025

    The model's exact answer did not match the frozen expected output.

    sha256:272f2e4f2da9ea2ced62603a9491cdbf7bde427a27fbd6c0b78d0cc81a9b9528
  14. Precedence TraceT026

    The model's exact answer did not match the frozen expected output.

    sha256:687d09e32a49f6ae75e4ea576203768074bd27bfe9583733c54b59079bb46116
  15. Slice TraceT028

    The model's exact answer did not match the frozen expected output.

    sha256:d932b8f0b71b209303a41fa812a3d20d4e2d982b6049a67ec56ac5354cc29016
  16. Alias TraceT029

    The model's exact answer did not match the frozen expected output.

    sha256:954f2beefd26fcd5e6cb5b2a2c28bb119417abe169f9491bc65c04dd919fa5e5
  17. Precedence TraceT030

    The model's exact answer did not match the frozen expected output.

    sha256:6087ab4384e8b7b3479c4d15bcff2be4fad085e8c79ace9aba61896536ac590d
  18. Precedence TraceT042

    The model's exact answer did not match the frozen expected output.

    sha256:050f9348bebba5924aee4fc40467a613ca9299e5ac1ac8f2c9c9386282bc2ec1
  19. Slice TraceT044

    The model's exact answer did not match the frozen expected output.

    sha256:65584756ca04817b22bffd10a6820abbac0e0505efe441b1b3fe3ded24bb587e
  20. Alias TraceT045

    The model's exact answer did not match the frozen expected output.

    sha256:ed182f4cc48dac8fd5572c3e861656646d936928d88e46c2e56e917dcaaa62a1
  21. Precedence TraceT046

    The model's exact answer did not match the frozen expected output.

    sha256:e3ede928d16046ff6d02e6c82bcebf39a52e2ac07e06acacb449b4e351437f28
  22. Loop TraceT047

    The model's exact answer did not match the frozen expected output.

    sha256:07cdad41d1cb39c009aa4d2284bee8f5b37a4e3efb8b6cc1f18cad6c8531eaf2
  23. Slice TraceT048

    The model's exact answer did not match the frozen expected output.

    sha256:c4807264d17449f33d8d168a0ed563e3bc873bc9b0d0e54a0085aac5a74b39a3
  24. Precedence TraceT050

    The model's exact answer did not match the frozen expected output.

    sha256:9e6d34eac6fc67531473aa5fb7dd107ac923c768ccfae22830a577d756259b98
  25. Alias TraceT061

    The model's exact answer did not match the frozen expected output.

    sha256:4a4faedcced5a49af5008535ac307acb6552a11e846511774832860ba7461876
  26. Precedence TraceT062

    The model's exact answer did not match the frozen expected output.

    sha256:23de48a7934be0d764e556e052929545d76b916b5c323090afe21166734f915e
  27. Loop TraceT063

    The model's exact answer did not match the frozen expected output.

    sha256:84b59eccbd8816170ae53a4400c19092a092f9cc92386d88bd86e496c7a04f79
  28. Slice TraceT064

    The model's exact answer did not match the frozen expected output.

    sha256:45f7d600ee08ffc075dfa74e3b7e9ff85465c7c44cff446ad5a9da89080c6805
  29. Alias TraceT065

    The model's exact answer did not match the frozen expected output.

    sha256:96c5f33d87485bd3aee91fa1c48c624e67d9638ee1f0db63620886e9c957e1de
  30. Loop TraceT067

    The model's exact answer did not match the frozen expected output.

    sha256:0a9e39db48b2c32d55b946ad866af392a01a7ab7da7d88ea0d9273d1c90637bd
  31. Slice TraceT068

    The model's exact answer did not match the frozen expected output.

    sha256:393874a57a3f0b7fb00303d8802c178e7ba8d7b45742b91eae0cd217ea8b5d85
  32. Alias TraceT069

    The model's exact answer did not match the frozen expected output.

    sha256:12a1fa4f20ab9b63baafb03b705469e004067f6996e5bdac50834331fd16a58f
  33. Precedence TraceT070

    The model's exact answer did not match the frozen expected output.

    sha256:efd32b7134ddd201a8a5e5d5c9765767b59a70b9c9f5a718c39d7b3d3ed8305a
  34. Alias TraceT081

    The model's exact answer did not match the frozen expected output.

    sha256:02b8cd509ef0ed7d5075870ab4b9c6d6460a1f732bf7bdd670483aa233758217
  35. Precedence TraceT082

    The model's exact answer did not match the frozen expected output.

    sha256:6c36dda3b779a5e6764c927468a6db507136ab7e413af7e312e7af8088692735
  36. Loop TraceT083

    The model's exact answer did not match the frozen expected output.

    sha256:ed4bae33cb39337bd87d38c8613d2858f1d545f437a931086d3469cbc9ec98f2
  37. Slice TraceT084

    The model's exact answer did not match the frozen expected output.

    sha256:36a52e3e14beb356bfbb204d3a7427b5d77d9da053358712b4b40aa06b5bf907
  38. Alias TraceT085

    The model's exact answer did not match the frozen expected output.

    sha256:ef9cc4b8dfd850bda1ca842c816f7f33d6ac26d6c88f77628a67eb8555c44114
  39. Loop TraceT087

    The model's exact answer did not match the frozen expected output.

    sha256:c6e5d3304ca0b3a831db539f376dd12c717da5ac6d6037559155b0818efb8bcf
  40. Alias TraceT089

    The model's exact answer did not match the frozen expected output.

    sha256:fe2728b960dea9e9993ee5422c190f9c96161c56018c0734ba8b8803242be2fd
  41. Precedence TraceT090

    The model's exact answer did not match the frozen expected output.

    sha256:7d2580ed3817e9bdadf3681ed4956b82e10ed0aadcec7cc6b45291837fd01fce

OFFICIAL SOURCES

Provider record.

An exact primary official launch or model-card source has not yet been verified for this captured model ID.

STATUSOfficial source pendingVerified: PendingResearch method: official primary-web fallback
  • No exact primary launch or model card is certified yet. This page will not infer one from a similar name.

Important: Statements in linked publisher material are provider claims. They are not findings of this benchmark.

METHOD & LIMITS

What this page can say.

Every public leaderboard clean percentage uses the last four complete checks, covering roughly two weeks, once enough certified history exists; until then it uses the latest Most Annoying 50-trap view. The 100-task run receipt is the wider audit bundle, not the benchmark denominator. Benchmark rank #1 means fewest verified mistakes among complete runs; the list can still be sorted by most mistakes for readability. OpenRouter feed rank is separate discovery metadata and is kept out of the benchmark rank column. Two-week average reporting will use the last four complete 100-task cycles when enough cycles exist. Individual verified mistakes, called catches internally, require primary and shadow checks to reproduce the exact mismatch from the recorded reply against the frozen expected output. Retrieval is not signature verification; auditors should recompute receipt roots and verify signatures against the published issuer key. Routing errors, timeouts, incomplete answers, and missing evidence stay outside the ranked score. Do not judge any model solely from this benchmark. Ranked complete runs must use the same 50 traps, scoring rules, model settings, and retry policy.

  1. Dual-check reproduction

    For each listed Most Annoying mistake, primary and shadow verification must both reproduce the exact mismatch from the recorded reply against the frozen expected output. Otherwise the item remains unresolved.

  2. Certified denominator

    The rankable score is the 50-trap Most Annoying view. The run receipt may say 100 tasks because it covers the wider audit bundle; that object is evidence, not a separate leaderboard denominator.

  3. Signature and feed rank

    Independent verification means recomputing the receipt root and checking the signature against the published issuer public key. OpenRouter rank stays discovery metadata and does not affect benchmark rank.

Reproduce this result

  1. Inspect the run receipt.
  2. Inspect each Most Annoying mistake receipt.
  3. Verify each receipt root and signature.
  4. Wait for the full proof bundle if it is not released yet.
  5. Rerun the exact prompt and expected-output comparison.

Claim ceiling: OpenRouter rank and metadata describe the captured discovery feed. Provider claims are separate from this benchmark. Scores describe the most recent public test pack and should not be used alone to judge the model generally.

Feed root
sha256:61e4106b1d08b7ef16ec9d332548214d01937a628e573fcf9a3091f601dfcb76
Model metadata root
sha256:8d604e07474bde4e19ed1b1601076d5dacbc17f2e1a3ab26cd674afaacd3692f
Official-source registry root
sha256:e5606a5133065340a402faa6c24a6bb3fb36d82809003a75bae28e85d7ec8e68

QUOTE THE RECORD

Share the result with its evidence.

Upstage: Solar Pro 4: 41 verified mistakes and 9 clean results across 50 sealed benchmark traps.

Discuss this result in:

GET A SECOND EXPLANATION

Ask your favorite AI what this means.

Copy a bounded prompt that includes this model page and its claim ceiling.