Back to programming-model index

MODEL EVIDENCE / OpenRouter #8

DeepSeek: DeepSeek V4 Pro 0423

The model identity, provider record, and independently verified benchmark results in one place. The number above is OpenRouter discovery order, not benchmark rank.

deepseek/deepseek-v4-pro
Official source verifiedComplete result
Fast numbersCaptured facts and latest status
OpenRouter feed rank
OpenRouter #8
Context
1048576
Input
text
Output
text
Reasoning flag
Yes
Prompt price
$0.792 / 1M tokens
Completion price
$2.376 / 1M tokens
Latest run
2026-09-07T17:19:44.592026+00:00
View denominator
50

DEEP BENCHMARK

What the run established.

Counts stay visible for auditability. A score appears only when the Most Annoying 50-trap view satisfies the independent checks.

MOST ANNOYING BENCHMARK

46/ 50

Complete result, latest run · 46 verified mistakes · 4 clean results · 0 unresolved

Inspect run receipt
Packs & trend

Pack 1: 8 verified mistakes, 2 clean results, 0 unresolved; Pack 2: 10 verified mistakes, 0 clean results, 0 unresolved; Pack 3: 9 verified mistakes, 1 clean results, 0 unresolved; Pack 4: 10 verified mistakes, 0 clean results, 0 unresolved; Pack 5: 9 verified mistakes, 1 clean results, 0 unresolved

2026-08-31T21:35:59.284247+00:00: 0; 2026-09-01T22:50:04.330589+00:00: 30; 2026-09-02T10:43:22.086711+00:00: not_run; 2026-09-03T18:44:32.089955+00:00: not_run; 2026-09-07T17:19:44.592026+00:00: 46

Score history

Model runs, then future slots.

  1. 01100%
  2. 0214%
  3. 03NOT RUN
  4. 04NOT RUN
  5. 058%
  6. 06NOT RUN
  7. 07NOT RUN
  8. 08NOT RUN
  9. 09NOT RUN
  10. 10NOT RUN
  11. 11NOT RUN
  12. 12NOT RUN
  13. 13NOT RUN
  14. 14NOT RUN
  15. 15NOT RUN
  16. 16NOT RUN
  17. 17NOT RUN
  18. 18NOT RUN
  19. 19NOT RUN
  20. 20NOT RUN
  21. 21NOT RUN
  22. 22NOT RUN
  23. 23NOT RUN
  24. 24NOT RUN
Verified mistakesClean resultsUnresolved / pendingMissing / no recorded result

Most Annoying verified mistake receipts

Only receipts from the Most Annoying view are listed here. Tolerable-view receipts are separate and are not added to this score.

  1. Alias TraceT001

    The model's exact answer did not match the frozen expected output.

    sha256:32cba95c27088b86ab19f0786f63959a9231c8fa69906fc401015023276cb476
  2. Precedence TraceT002

    The model's exact answer did not match the frozen expected output.

    sha256:bab63512d549d246650cb91d2824dcad67db31e4b4682be48f17eebf39182811
  3. Loop TraceT003

    The model's exact answer did not match the frozen expected output.

    sha256:7aea6ce5f1e2f7e628d78480af53950f95791430d4bd2cce82dc0e753f1d6cc6
  4. Slice TraceT004

    The model's exact answer did not match the frozen expected output.

    sha256:4c1096365a9462dcedb5b62755d97804765f4695ac02ed7519467c574fd4bb45
  5. Alias TraceT005

    The model's exact answer did not match the frozen expected output.

    sha256:581307e025363cec900a4a116e886a1bd20969ade3f2ce2deb200c7835c34945
  6. Loop TraceT007

    The model's exact answer did not match the frozen expected output.

    sha256:b975db3ca583631559d10bc0441855888c1764960d21d697cc8a0fae40420dee
  7. Slice TraceT008

    The model's exact answer did not match the frozen expected output.

    sha256:4b1b53af180f84a532ded9887268bad2bc1d569ee755be6d0dbe30cbde8c3b94
  8. Precedence TraceT010

    The model's exact answer did not match the frozen expected output.

    sha256:5929c7334a3ec768f3ac12d8a93d36e3d4b74a406e64ec73a561784fcbfb3a28
  9. Alias TraceT021

    The model's exact answer did not match the frozen expected output.

    sha256:4d554d53e8d256020f17aaa1beb6ad14a5c9254b501318f98224e1899c443f70
  10. Precedence TraceT022

    The model's exact answer did not match the frozen expected output.

    sha256:8ec5349440bc2e2ce32629c04aa34fdd08bde93c128259e363d51a2a9bbdc16b
  11. Loop TraceT023

    The model's exact answer did not match the frozen expected output.

    sha256:2954a87322539d2103f7d64059c6bbe98b8559f36adda87386ac411b2c90bd3e
  12. Slice TraceT024

    The model's exact answer did not match the frozen expected output.

    sha256:af1397dbd0be0a068d4830c0545f28e837451dad7c9690228314421772caef03
  13. Alias TraceT025

    The model's exact answer did not match the frozen expected output.

    sha256:c3eae888fb7394fe76da11e759c32ccddd1403697a25786c08a9dffb22f19bec
  14. Precedence TraceT026

    The model's exact answer did not match the frozen expected output.

    sha256:8f056dcef1bd5353b4d0d7cebc8f541e64f343a111222bd5b67c4cdb921d0792
  15. Loop TraceT027

    The model's exact answer did not match the frozen expected output.

    sha256:8189c5e283be291e6e1813f6cea8ab7910cff39a3e2b3c01bd9966f3b35e7427
  16. Slice TraceT028

    The model's exact answer did not match the frozen expected output.

    sha256:805df16f93d1415813effcf7885af45765fe9470dbcb2354ed285b999d2a1964
  17. Alias TraceT029

    The model's exact answer did not match the frozen expected output.

    sha256:541b1d2f1def2f6a6c1aaa90f4125947c64b2f81cb2dbb5b2271563b9c4b1800
  18. Precedence TraceT030

    The model's exact answer did not match the frozen expected output.

    sha256:72455aed2f8a4396924dfdea2ef0bb8d259a9f85c4e3e1f705ed591fa5a5eead
  19. Alias TraceT041

    The model's exact answer did not match the frozen expected output.

    sha256:8c1c3b9672dfcefbaa1ebc0b5d59e174f17e60d669624ebf51c312ac48b5c50f
  20. Precedence TraceT042

    The model's exact answer did not match the frozen expected output.

    sha256:c6187c819857441affc5b1e6213f7f77b818ac48b6b546b5e8241fe48cc90e18
  21. Slice TraceT044

    The model's exact answer did not match the frozen expected output.

    sha256:735d4c02d200ab0080289e5b29e3e5baf0c710b6b21b9c8014ad36cf94bd1fe6
  22. Alias TraceT045

    The model's exact answer did not match the frozen expected output.

    sha256:f9dacde5587a1aab80c7de2bfc6be1064023a0b8a3bf24bd4bcdce6b48c6a65b
  23. Precedence TraceT046

    The model's exact answer did not match the frozen expected output.

    sha256:03f0ef13ddd8087f1b67d4efdbb67abe1d2edf9cf3ec63bbba8930f696d3a49b
  24. Loop TraceT047

    The model's exact answer did not match the frozen expected output.

    sha256:bdd3d7be28d4a9b4626a56dcae580d4cb46f5a85d77c4fb900c81f91d13b797a
  25. Slice TraceT048

    The model's exact answer did not match the frozen expected output.

    sha256:53c408dee5447a8cb90aafb7f1d1a7b38724f9ceca931217ba92ac370234884c
  26. Alias TraceT049

    The model's exact answer did not match the frozen expected output.

    sha256:4a59c255af0b4b84c64cf4adcc7a121f10cc2e1e3bf3ed966c33d69e6ebbc957
  27. Precedence TraceT050

    The model's exact answer did not match the frozen expected output.

    sha256:0dbc9fa0b48b60fbad2c2f49756025990ff21791dbf2d78898bf56e2e174e4d6
  28. Alias TraceT061

    The model's exact answer did not match the frozen expected output.

    sha256:1e3e5db2b09637d6f36031ba47d2650ad92352e50b2ea44281c1caea7696ccae
  29. Precedence TraceT062

    The model's exact answer did not match the frozen expected output.

    sha256:6c313b5e82b49d9e05e96962c4d9473fee2cff29feb38c6de2124bc9a2ab43fd
  30. Loop TraceT063

    The model's exact answer did not match the frozen expected output.

    sha256:9cc41968c0846e4db02e509572f1dff1b5f3cfd8aea4a9fa9d703a2311020491
  31. Slice TraceT064

    The model's exact answer did not match the frozen expected output.

    sha256:61605530d23e610c40beb9da2b993f2ee607e924bbecbcdd8b599ca7ec9615a7
  32. Alias TraceT065

    The model's exact answer did not match the frozen expected output.

    sha256:76267b159f9f0556b9a3f8925131004db908d84c262efd83672ca38773dc69d0
  33. Precedence TraceT066

    The model's exact answer did not match the frozen expected output.

    sha256:4d0f204f149a19501e15e9ebd036b2d826af18a177442859d30b49fcdb1cf268
  34. Loop TraceT067

    The model's exact answer did not match the frozen expected output.

    sha256:51d620513020b393e11d06e190670bcb32f0be5e2614b5b6838913fc20a8da53
  35. Slice TraceT068

    The model's exact answer did not match the frozen expected output.

    sha256:cfaa03fd6e74911ca3e468e11f4fbc0993edf204d9d829218304eebb6f1f686a
  36. Alias TraceT069

    The model's exact answer did not match the frozen expected output.

    sha256:3ccd469fe2a190db096857fef16e4e1ef0b0397d6b68232892c0a4d047e41fb1
  37. Precedence TraceT070

    The model's exact answer did not match the frozen expected output.

    sha256:46fa4076debdde499d5703f0085aac94ea02ed2ad40748fef141f2993b4b8f13
  38. Alias TraceT081

    The model's exact answer did not match the frozen expected output.

    sha256:e858aa6dce3a68e6e9c8b8dbde6816362705cda5e104817d7eaa1a4feec21ccb
  39. Precedence TraceT082

    The model's exact answer did not match the frozen expected output.

    sha256:b8b86836c21d2a49fd1a02df005f0330e2fde560625e522820cd4dd4c26bff95
  40. Loop TraceT083

    The model's exact answer did not match the frozen expected output.

    sha256:c3f21dd84e6d0f3789a273e1503532639d5cf4840f8a1e91b1edb5663451a040
  41. Slice TraceT084

    The model's exact answer did not match the frozen expected output.

    sha256:51d13f9e2002bc36bcf7f7c0862d6a6dc60ca76463605f406a3106a1d23e541c
  42. Alias TraceT085

    The model's exact answer did not match the frozen expected output.

    sha256:268fc1d7904e8c29a4ff8e71a275d6ccf9efc18d32796aa44eb19862f7edeaf6
  43. Precedence TraceT086

    The model's exact answer did not match the frozen expected output.

    sha256:ecbd9430120f85c5833c6bdbd3d36de13b92252054cfd0b4b5d201172eae0ebd
  44. Loop TraceT087

    The model's exact answer did not match the frozen expected output.

    sha256:6b68bb9f1503d664dcd96d4250497941abd7b3fc4a36aea43c86182a807610aa
  45. Slice TraceT088

    The model's exact answer did not match the frozen expected output.

    sha256:c09ed573ec02a3533babcf2b66984d26be34d6c1515d0e252ba5723ec486afc0
  46. Alias TraceT089

    The model's exact answer did not match the frozen expected output.

    sha256:b11f5cbf5d14ac0f89c21c2c686dcf3a75e16692a126b570af7ffbbb32429efc

OFFICIAL SOURCES

Provider record.

DeepSeek describes this model family in its official updates and transparency material. Capabilities stated there are provider claims, separate from our benchmark.

STATUSOfficial source verifiedVerified: 2026-08-27T00:00:00+00:00Research method: official primary-web fallback

Important: Statements in linked publisher material are provider claims. They are not findings of this benchmark.

METHOD & LIMITS

What this page can say.

Every public leaderboard clean percentage uses the last four complete checks, covering roughly two weeks, once enough certified history exists; until then it uses the latest Most Annoying 50-trap view. The 100-task run receipt is the wider audit bundle, not the benchmark denominator. Benchmark rank #1 means fewest verified mistakes among complete runs; the list can still be sorted by most mistakes for readability. OpenRouter feed rank is separate discovery metadata and is kept out of the benchmark rank column. Two-week average reporting will use the last four complete 100-task cycles when enough cycles exist. Individual verified mistakes, called catches internally, require primary and shadow checks to reproduce the exact mismatch from the recorded reply against the frozen expected output. Retrieval is not signature verification; auditors should recompute receipt roots and verify signatures against the published issuer key. Routing errors, timeouts, incomplete answers, and missing evidence stay outside the ranked score. Do not judge any model solely from this benchmark. Ranked complete runs must use the same 50 traps, scoring rules, model settings, and retry policy.

  1. Dual-check reproduction

    For each listed Most Annoying mistake, primary and shadow verification must both reproduce the exact mismatch from the recorded reply against the frozen expected output. Otherwise the item remains unresolved.

  2. Certified denominator

    The rankable score is the 50-trap Most Annoying view. The run receipt may say 100 tasks because it covers the wider audit bundle; that object is evidence, not a separate leaderboard denominator.

  3. Signature and feed rank

    Independent verification means recomputing the receipt root and checking the signature against the published issuer public key. OpenRouter rank stays discovery metadata and does not affect benchmark rank.

Reproduce this result

  1. Inspect the run receipt.
  2. Inspect each Most Annoying mistake receipt.
  3. Verify each receipt root and signature.
  4. Wait for the full proof bundle if it is not released yet.
  5. Rerun the exact prompt and expected-output comparison.

Claim ceiling: OpenRouter rank and metadata describe the captured discovery feed. Provider claims are separate from this benchmark. Scores describe the most recent public test pack and should not be used alone to judge the model generally.

Feed root
sha256:61e4106b1d08b7ef16ec9d332548214d01937a628e573fcf9a3091f601dfcb76
Model metadata root
sha256:dd738d4bb97b3a03f52c2aa565cbd217221007fa607ee411b09ec92bfe4ebefc
Official-source registry root
sha256:e5606a5133065340a402faa6c24a6bb3fb36d82809003a75bae28e85d7ec8e68

QUOTE THE RECORD

Share the result with its evidence.

DeepSeek: DeepSeek V4 Pro 0423: 46 verified mistakes and 4 clean results across 50 sealed benchmark traps.

Discuss this result in:

GET A SECOND EXPLANATION

Ask your favorite AI what this means.

Copy a bounded prompt that includes this model page and its claim ceiling.