OpinionReady

AI and research

Open-ends written by a language model

The tells are not what most detection guides say they are, and the obvious ones remove careful writers along with the pasted answers.

A person typing a long answer on a laptop at a home desk

Outline. Each heading below carries one line saying what the section has to establish. Expand each into two to four paragraphs, put at least one number or worked example in the piece that nobody else could publish, then delete this note.

Pasted answers arrive well-formed, on topic, and slightly too general. The reflex is to flag the long and polished ones, which removes your most articulate respondents first.

Why length and polish are the wrong signals

The false-positive cost: careful writers look exactly like this, and they are the ones worth keeping.

Tells that hold up

Restating the question, absence of specific referents, uniform sentence rhythm, no self-correction.

Paste timing carries more information than the text does

Time-to-first-keystroke and a single insertion event. What you can log without reading the answer.

Design the question so a model is the slower route

Ask for something personal, recent and checkable against another answer in the same instrument.

Automated text scoring should never be the verdict

It removes people for writing tersely, and they cannot contest a number nobody will explain.

What we do with a flagged open-end

Drop the response, review the pattern, and keep the person unless the pattern repeats.

Filed under AI and research

Who wrote this

OpinionReady Method Desk — Panel operations and data quality

The people who run the exchange day to day — supply operations, quality review and the payout queue. These notes come out of work we had to do anyway, written down because the same questions keep arriving from buyers and from members.

Written from our own operating record: the screening calls, field estimates and payout runs described here are ones we make on this exchange, not secondhand summaries of research done elsewhere.

More on ai and research

Everything on this topic