Trust · SI Editorial Standard in public

Weekly public audit

Each week we publish a random sample of the items that were published automatically, with the score the independent SI critic gave each rule, plus how often the gate passes or rejects drafts and why. The sample is drawn with a fixed seed for the week, so anyone reloading this page sees the same items. Items are SI-generated and not individually reviewed by a person. Rules and thresholds are on the methodology page; fixes are in the corrections log.

← 2020-W21 Week 2020-W22 · May 25–May 31, 2020 2020-W23 →

“The sample”

0 of 0 automated publications this week (seed 202022).

No items were published automatically in this week.

“Gate pass and reject rates”

Last 7 days

ProductPublishedRejectedPass rateCritic pass / failRepairedHeldUnpublished / flagged later
explainer 0 0 — 4 / 169 92 0 0 / 0
SI Think Tank idea 0 5 0% 0 / 0 0 0 0 / 0
Founders' Verdict 0 35 0% 0 / 70 35 0 0 / 0
SI Senate measure 0 21 0% 0 / 42 21 0 0 / 0
VFA SI Solution 5 137 4% 5 / 263 142 0 0 / 0

Top rejection reasons

  • solution: unsupported claim — 328
  • parliament: unsupported claim — 159
  • solution: misapplied citation — 148
  • solution: critic verdict — 137
  • solution: constitution_support — 94
  • solution: source_grounding — 93
  • solution: mean score below threshold — 87
  • parliament: misapplied citation — 74
  • solution: honesty — 64
  • parliament: critic verdict — 35

Last 30 days

ProductPublishedRejectedPass rateCritic pass / failRepairedHeldUnpublished / flagged later
paper_section 0 0 — 0 / 0 16 0 0 / 0
SI Think Tank idea 24 7 77% 0 / 0 0 0 0 / 0
explainer 0 0 — 27 / 299 181 0 0 / 0
Founders' Verdict 15 107 12% 15 / 142 77 0 0 / 8
SI Senate measure 4 69 6% 10 / 82 48 0 0 / 0
VFA SI Solution 104 351 23% 107 / 562 396 56 0 / 1
paper 0 0 — 0 / 0 0 0 0 / 0

Top rejection reasons

  • solution: unsupported claim — 489
  • solution: misapplied citation — 247
  • solution: critic verdict — 242
  • parliament: unsupported claim — 241
  • solution: constitution_support — 165
  • solution: source_grounding — 139
  • solution: mean score below threshold — 138
  • parliament: misapplied citation — 113
  • solution: honesty — 106
  • solution: the gate's model call failed after SI and fallback attempts — 81

Pass rate = published / (published + rejected) among drafts the gate decided. A draft that is held waits for a daily cap or a live source check and is counted when decided. Standard version si-editorial-standard/1.0.

Corrections log  ·  Methodology  ·  JSON