Back to programming-model index

MODEL EVIDENCE / OpenRouter #18

Google: Gemini 2.5 Flash Lite

The model identity, provider record, and independently verified benchmark results in one place. The number above is OpenRouter discovery order, not benchmark rank.

google/gemini-2.5-flash-lite
Official source pendingComplete result
Fast numbersCaptured facts and latest status
OpenRouter feed rank
OpenRouter #18
Context
1048576
Input
text, image, file, audio, video
Output
text
Reasoning flag
Yes
Prompt price
$0.100 / 1M tokens
Completion price
$0.400 / 1M tokens
Latest run
2026-09-02T10:43:22.086711+00:00
View denominator
50

DEEP BENCHMARK

What the run established.

Counts stay visible for auditability. A score appears only when the Most Annoying 50-trap view satisfies the independent checks.

MOST ANNOYING BENCHMARK

46/ 50

Complete result, latest run · 46 verified mistakes · 4 clean results · 0 unresolved

Inspect run receipt
Packs & trend

Pack 1: 9 verified mistakes, 1 clean results, 0 unresolved; Pack 2: 9 verified mistakes, 1 clean results, 0 unresolved; Pack 3: 9 verified mistakes, 1 clean results, 0 unresolved; Pack 4: 9 verified mistakes, 1 clean results, 0 unresolved; Pack 5: 10 verified mistakes, 0 clean results, 0 unresolved

2026-08-31T21:35:59.284247+00:00: not_run; 2026-09-01T22:50:04.330589+00:00: not_run; 2026-09-02T10:43:22.086711+00:00: 46; 2026-09-03T18:44:32.089955+00:00: not_run

Score history

Model runs, then future slots.

  1. 01NOT RUN
  2. 02NOT RUN
  3. 038%
  4. 04NOT RUN
  5. 05NOT RUN
  6. 06NOT RUN
  7. 07NOT RUN
  8. 08NOT RUN
  9. 09NOT RUN
  10. 10NOT RUN
  11. 11NOT RUN
  12. 12NOT RUN
  13. 13NOT RUN
  14. 14NOT RUN
  15. 15NOT RUN
  16. 16NOT RUN
  17. 17NOT RUN
  18. 18NOT RUN
  19. 19NOT RUN
  20. 20NOT RUN
  21. 21NOT RUN
  22. 22NOT RUN
  23. 23NOT RUN
  24. 24NOT RUN
Verified mistakesClean resultsUnresolved / pendingMissing / no recorded result

Most Annoying verified mistake receipts

Only receipts from the Most Annoying view are listed here. Tolerable-view receipts are separate and are not added to this score.

  1. Alias TraceT001

    The model's exact answer did not match the frozen expected output.

    sha256:eca0567566ff364a322f59e1e084d7343ea390c9aae4b58bc56ece2a9631674f
  2. Precedence TraceT002

    The model's exact answer did not match the frozen expected output.

    sha256:f74871c6651ff9fb57f0da291756c0e1957374bed37b955faf192bc7f16df903
  3. Loop TraceT003

    The model's exact answer did not match the frozen expected output.

    sha256:07f884fda61e3f1f29fab713af07ac1392e2286af5c7db9ded6498e8009a66e3
  4. Slice TraceT004

    The model's exact answer did not match the frozen expected output.

    sha256:82ce51f1a8478d73e6c613b355f5b96455df762f0661bd96a82c95a179513b2c
  5. Alias TraceT005

    The model's exact answer did not match the frozen expected output.

    sha256:8c072296838a133864d27cf9e701d1572b1df180262cf54327d4c4710c100488
  6. Precedence TraceT006

    The model's exact answer did not match the frozen expected output.

    sha256:62c9a53cb51fea47f0223ecd8d5c621019a9380860da9109de736f2b9ecafeaf
  7. Loop TraceT007

    The model's exact answer did not match the frozen expected output.

    sha256:19362c644b376ddf735e38889abc562c3c1992abdab45f1fcc1a3b31cadf8ffd
  8. Slice TraceT008

    The model's exact answer did not match the frozen expected output.

    sha256:6a6c0fb363577b6ad52fa5a8761cc1c759d3a56db7daacffd952a0bcc42e8500
  9. Alias TraceT009

    The model's exact answer did not match the frozen expected output.

    sha256:51c9c99c0d914a7894bcc6b18df29c7ff34e9dbdc5d8955df16f66248dcfb625
  10. Alias TraceT021

    The model's exact answer did not match the frozen expected output.

    sha256:b54d8d57fadb82aebcd6ab266d939cc05b852944f8abc7b358e665f380748e31
  11. Precedence TraceT022

    The model's exact answer did not match the frozen expected output.

    sha256:ceecf48ede86ec1cf1bc1f23ea831e6a9c087a805a08bd122d37c27b5a3ce71f
  12. Loop TraceT023

    The model's exact answer did not match the frozen expected output.

    sha256:0ffbd7fd7748da5dbecb20f25ae0b61ee9babbcc03de0430bfa653d0f3d6663e
  13. Slice TraceT024

    The model's exact answer did not match the frozen expected output.

    sha256:7fa229aba6ff18625c16f2bac511f1b079e2a2a2d934783c6a80e3a65043d590
  14. Alias TraceT025

    The model's exact answer did not match the frozen expected output.

    sha256:bfb911909c5d321d95193b16b326a94f252d4daf0b3bed007eb37c79f676aaf2
  15. Precedence TraceT026

    The model's exact answer did not match the frozen expected output.

    sha256:1a0e0af003aa4733c480a9c6ac6762290b90eeb48435d3170de28dae1fa03785
  16. Loop TraceT027

    The model's exact answer did not match the frozen expected output.

    sha256:1af1b5a2f5a87ee38d5b88daf9a800cb1d6c57cee06c42a705161da18c18e6ec
  17. Alias TraceT029

    The model's exact answer did not match the frozen expected output.

    sha256:bd89b681484a976aee06db89a5c46dc33d6602f5d81d78df2bc62e78ab61001a
  18. Precedence TraceT030

    The model's exact answer did not match the frozen expected output.

    sha256:6852efe042cb26210d9ebbfaeb1aa2dbb1e747e2ffcc237f68c0d71c101134f6
  19. Alias TraceT041

    The model's exact answer did not match the frozen expected output.

    sha256:1d926b22db3c3eee3890d67ec5a2697a1047c966daa2fd3e8efdc624accf4339
  20. Loop TraceT043

    The model's exact answer did not match the frozen expected output.

    sha256:362e10d262861593a49c504b28dc8aee151b865c6f1455c24f5c4bcaf125ba78
  21. Slice TraceT044

    The model's exact answer did not match the frozen expected output.

    sha256:92ee6d6d9eeca977ad61d923cfab7011bf7b2ed37d1604c7f54d2bd039894819
  22. Alias TraceT045

    The model's exact answer did not match the frozen expected output.

    sha256:d613407496752ef2fa5ddef9a83c85e408f19407d50d71c8a9c09f57c64b9052
  23. Precedence TraceT046

    The model's exact answer did not match the frozen expected output.

    sha256:dc1700a8de00838c77f3fb21bd95ed85a2e39a5530324f3d8fb3e92a79c94826
  24. Loop TraceT047

    The model's exact answer did not match the frozen expected output.

    sha256:4e38e87f42a374c3b928a75166e4389a2aacd385ec254991a0708082cc62ed60
  25. Slice TraceT048

    The model's exact answer did not match the frozen expected output.

    sha256:f2e23b15984dcedf3addfdc87df83e93ae57e4bd088a14216ee58d4fd64b2b32
  26. Alias TraceT049

    The model's exact answer did not match the frozen expected output.

    sha256:4608c42aedcfcd212c976805d0dc6c5cc651dc87f65d078dd8783087a13a5485
  27. Precedence TraceT050

    The model's exact answer did not match the frozen expected output.

    sha256:e38bf2e2ba3705005fab79e66957c73fec9e1093da829bf1c16f788b98f3f25e
  28. Alias TraceT061

    The model's exact answer did not match the frozen expected output.

    sha256:5204cb3c2114a46ca78dc8de50e119dd3ae100668da54c269b03d10c45694839
  29. Precedence TraceT062

    The model's exact answer did not match the frozen expected output.

    sha256:3cbb5329609caa8e158ecefa8e8b80838beb70507fdde18cab8699be535d39ca
  30. Loop TraceT063

    The model's exact answer did not match the frozen expected output.

    sha256:924b5b0ec2e93dfc472cb7dfc1c459a9f9adfce890a477038eb310423d7fb6db
  31. Slice TraceT064

    The model's exact answer did not match the frozen expected output.

    sha256:701fff27d4bd4e848084e4b4fb3a27a61548c14e6d13e0a8960a0ff7ffe71d3c
  32. Alias TraceT065

    The model's exact answer did not match the frozen expected output.

    sha256:62d1e7494671fc3c4f0e491f3eeeb2591a29b4dcb935187e03f623e4eb6185ae
  33. Loop TraceT067

    The model's exact answer did not match the frozen expected output.

    sha256:58ddc62386186171f3de17a71cee9d08bace26adb624c0771b5e38539d7d136b
  34. Slice TraceT068

    The model's exact answer did not match the frozen expected output.

    sha256:3813da20e0bad28cdae404e4366b0b0f47549b615d3202543d8b2a85b7c8c118
  35. Alias TraceT069

    The model's exact answer did not match the frozen expected output.

    sha256:501b7de7d37b2bea7597929d8a9d4a0d07f9783d84aee5c55ca29d0e5f534270
  36. Precedence TraceT070

    The model's exact answer did not match the frozen expected output.

    sha256:96c78519fb9e5acb93aef098ff7f18dabebdd10ef23ad33828720f148340f723
  37. Alias TraceT081

    The model's exact answer did not match the frozen expected output.

    sha256:6c0cbf14d8ddf4650548fae9d000b00ea31c4794a7a725506e4453a00b05e122
  38. Precedence TraceT082

    The model's exact answer did not match the frozen expected output.

    sha256:e64a1e25ace2cb6eb1fa1e992a668c7d5656dc4b51cae14149472ac09246e6b2
  39. Loop TraceT083

    The model's exact answer did not match the frozen expected output.

    sha256:6e39d3b7a03a23af3cb4c5e1d534ddadb9eec84d727a0e1c5a424a2b303f0f03
  40. Slice TraceT084

    The model's exact answer did not match the frozen expected output.

    sha256:5a3dc6d24d2197aec088556590cc29651624fc0e2c2b414e0f9b2d70b562c0da
  41. Alias TraceT085

    The model's exact answer did not match the frozen expected output.

    sha256:2902d39bddae9bfd9c2990e93eb3bc75453d630ce42e82f662cac98c1a99325a
  42. Precedence TraceT086

    The model's exact answer did not match the frozen expected output.

    sha256:873e5140fb36aa7934cf84de78c440962282eef90cc26ef108e486d8a0e04c16
  43. Loop TraceT087

    The model's exact answer did not match the frozen expected output.

    sha256:961ccec3846942eb5bbdfd25e0a28bdff3004a304646ba4ef5a73545faab2997
  44. Slice TraceT088

    The model's exact answer did not match the frozen expected output.

    sha256:062cde38581081135e580d7369fa04baf6e6150909f0841eeed9c9e9c6293e34
  45. Alias TraceT089

    The model's exact answer did not match the frozen expected output.

    sha256:9353801833900a0b6377378d78cb260e225c249b1b7f9ce82b44b4a7fbba8713
  46. Precedence TraceT090

    The model's exact answer did not match the frozen expected output.

    sha256:7db2986cb5e1b335145226603fd2a01419d1edf0f8cf517f106f296a8d43d488

OFFICIAL SOURCES

Provider record.

An exact primary official launch or model-card source has not yet been verified for this captured model ID.

STATUSOfficial source pendingVerified: PendingResearch method: official primary-web fallback
  • No exact primary launch or model card is certified yet. This page will not infer one from a similar name.

Important: Statements in linked publisher material are provider claims. They are not findings of this benchmark.

METHOD & LIMITS

What this page can say.

Every public leaderboard clean percentage uses the last four complete checks, covering roughly two weeks, once enough certified history exists; until then it uses the latest Most Annoying 50-trap view. The 100-task run receipt is the wider audit bundle, not the benchmark denominator. Benchmark rank #1 means fewest verified mistakes among complete runs; the list can still be sorted by most mistakes for readability. OpenRouter feed rank is separate discovery metadata and is kept out of the benchmark rank column. Two-week average reporting will use the last four complete 100-task cycles when enough cycles exist. Individual verified mistakes, called catches internally, require primary and shadow checks to reproduce the exact mismatch from the recorded reply against the frozen expected output. Retrieval is not signature verification; auditors should recompute receipt roots and verify signatures against the published issuer key. Routing errors, timeouts, incomplete answers, and missing evidence stay outside the ranked score. Do not judge any model solely from this benchmark. Ranked complete runs must use the same 50 traps, scoring rules, model settings, and retry policy.

  1. Dual-check reproduction

    For each listed Most Annoying mistake, primary and shadow verification must both reproduce the exact mismatch from the recorded reply against the frozen expected output. Otherwise the item remains unresolved.

  2. Certified denominator

    The rankable score is the 50-trap Most Annoying view. The run receipt may say 100 tasks because it covers the wider audit bundle; that object is evidence, not a separate leaderboard denominator.

  3. Signature and feed rank

    Independent verification means recomputing the receipt root and checking the signature against the published issuer public key. OpenRouter rank stays discovery metadata and does not affect benchmark rank.

Reproduce this result

  1. Inspect the run receipt.
  2. Inspect each Most Annoying mistake receipt.
  3. Verify each receipt root and signature.
  4. Wait for the full proof bundle if it is not released yet.
  5. Rerun the exact prompt and expected-output comparison.

Claim ceiling: OpenRouter rank and metadata describe the captured discovery feed. Provider claims are separate from this benchmark. Scores describe the most recent public test pack and should not be used alone to judge the model generally.

Feed root
sha256:61e4106b1d08b7ef16ec9d332548214d01937a628e573fcf9a3091f601dfcb76
Model metadata root
sha256:14b8029d35483b2f3f35a3dea35e0e150d239d6c472ed21f79798e344ecf4104
Official-source registry root
sha256:e5606a5133065340a402faa6c24a6bb3fb36d82809003a75bae28e85d7ec8e68

QUOTE THE RECORD

Share the result with its evidence.

Google: Gemini 2.5 Flash Lite: 46 verified mistakes and 4 clean results across 50 sealed benchmark traps.

Discuss this result in:

GET A SECOND EXPLANATION

Ask your favorite AI what this means.

Copy a bounded prompt that includes this model page and its claim ceiling.