substance_lens

prompt specv0.5.9

What it is

A JSON prompt spec you give a chat model so it checks an argument step by step and scans it for 67 fallacies, on both the claim and its strongest counter-case. Flags are judgments to verify, not proofs.

Runs on: Any capable chat model · a prompt spec, built with Grok in mind; no code ships

Who it's for

Anyone who wants a slower, structured second read of an argument, including their own: a writer checking a draft, a researcher auditing a source, or someone weighing two sides of a contested topic. It isn't a fact-checker, and it isn't an automated grader. Its output is a list of leads for a person to confirm.

How to use it

  1. Load the spec. Open substance_lens_0.5.9.json and paste the whole file into a new chat, or attach it.
  2. Give it something to check. In the same chat, paste the text and say what you want, for example run full pipeline on <claim>.
  3. Check what comes back. Each flag should name the side it was found on, the fallacy ID, the quoted span, the check type and the repair. Check every quote against the source yourself. To have the model audit its own answer, reply lens that response.

It was written with Grok in mind. Any chat model can read the file, but the consistency numbers below come from a single model family.

What it does

The spec gives the model a fixed order of work:

A fallacy flag withdraws support from one step. It does not show the conclusion is false. Repairs must be stated, never made silently.

What it doesn't do

Measured consistency. The Grokipedia Truth Audit ran the v0.5.9 fallacy scan three times over the same saved snapshots. From run 2 to run 3, 60% of the flagged sentences were flagged again; on the shared sentences, 79% got the same fallacy ID and 97% the same side. All runs used one model family and one framework, so this shows the method is consistent. It does not show the method is correct. Treat each single flag as a lead to check by hand.

Where it's used

Status

Links

← Back to home