OpinionReady

Sampling and reach

Healthcare sample and the cost of verification

Self-reported clinical roles are wrong often enough that the whole category is priced around finding out.

A carer and an older person sitting together in a bright room

Healthcare is the category where self-report fails hardest and the consequences are worst. The price reflects verification, not scarcity.

Why self-report fails harder here

In most consumer research, a respondent who misstates their job title creates a weighting nuisance. In healthcare research, the same error can invalidate an entire quote on prescribing behaviour, treatment pathways, or purchasing intent. The reason is structural: clinical roles carry authority, income, and professional identity, which makes them unusually attractive to overstate. A respondent who says they are a “consultant cardiologist” may be a cardiology trainee, a general physician with an interest in cardiology, a former clinician now working in industry, or someone with no clinical role at all.

Title inflation is only the first layer. Scope of practice differs materially across markets, and the same English word can describe very different levels of authority. In one market, a “consultant” may be a senior specialist who independently owns treatment decisions; in another, the equivalent title may describe a mid-career hospital physician who still requires approval for certain therapies. A global study that treats “consultant” as one category can therefore mix decision-makers with people who influence but do not decide.

Aspirational specialty claims add a third distortion. Respondents may name the specialty they trained in, the specialty they intend to enter, or the specialty they most identify with professionally. A nurse may describe themselves as an “oncology specialist” because they work on an oncology ward; a pharmacist may call themselves a “clinical pharmacist” although their daily work is dispensing. None of these answers is necessarily dishonest, but none is precise enough to support a study about oncology treatment decisions or formulary influence.

The consequence shows up in feasibility. A client may ask for 200 “US oncologists who treat metastatic breast cancer and have prescribed or recommended a CDK4/6 inhibitor in the past six months.” A panel can find many people who select “oncologist” and many who select the drug. The expensive part is establishing that the same person holds an active clinical role, treats the relevant patient population, and has recent decision-making involvement. That is why healthcare sample is not simply consumer sample with a higher CPI.

Licence verification: what it can and cannot confirm

Licence verification confirms that a credential exists. It does not confirm current practice, specialty mix, patient volume, or whether the person still sees the patients your study requires. This distinction is the difference between a credential check and a research qualification.

A licence lookup can establish that a person is, or was, registered with a relevant authority: for example, that “Dr. A. Tanaka” holds an active medical licence in a given jurisdiction. It cannot establish that they currently work in clinical practice rather than in insurance, pharma, academia, or administration. Nor can it establish that their licence category matches the decision-making role in the brief. A person can hold an active licence but not have seen a patient in two years.

A practical example makes the gap visible. Suppose a study requires 100 US dermatologists who see at least 20 psoriasis patients per month. Licence verification may confirm 100 active dermatology licences, but it cannot tell you that each respondent currently practices clinical dermatology, treats adults rather than paediatric patients, has a moderate-to-severe psoriasis caseload, or is involved in biologic selection. Those facts require a layered qualification process: registry or licence validation, employer and role confirmation, specialty and setting checks, patient-volume estimation, and disease-area-specific screening.

Verification also has limits imposed by data availability and privacy. Some registries are public but incomplete; some allow name-and-state lookup but not specialty; some countries require consent or restrict automated checking; and many clinicians use names that differ from their panel profile because of marriage, transliteration, or professional publication conventions. A responsible provider therefore treats verification as one input to a decision, not as a binary “verified clinician” label. The correct output is a documented evidence trail: what was checked, what source was used, what it confirmed, and what remains self-reported.

Specialty drift

A profile collected three years ago may name a specialty the person no longer practises. Healthcare careers move: clinicians change employers, move from hospital to private practice, take industry roles, retrain, reduce clinical hours, or shift from one disease area to another. A panel profile is a snapshot; a research audience needs a current claim.

Consider a respondent profiled in 2023 as a “general surgeon with an interest in colorectal surgery.” By 2026, they may have moved into a hospital administrative role, entered a pharmaceutical medical-affairs position, or reduced operating sessions after parental leave. If the study requires surgeons currently performing colorectal procedures, the old profile is not merely stale—it is misleading. The respondent may sincerely still describe themselves as a surgeon, while no longer meeting the practical definition.

Specialty drift is especially common at the boundary between clinical and industry work. A physician who joins a medical-affairs team often retains their clinical title in professional profiles, conference bios, and panel records. They may also retain a small amount of clinical work. For a study about real-world treatment decisions, the relevant question is not “Are you a doctor?” but “In the past month, how many patients with this condition did you personally manage, and what was your role in therapy selection?”

A useful audit is to re-ask a small set of anchor questions at study entry rather than relying on stored profile fields. For example, ask for current primary setting, weeks per month in patient-facing practice, percentage of time in the relevant specialty, and number of patients seen with the target condition in the past 30 days. If 20% of a supposed cardiologist sample reports no in-clinic patient contact in the past month, that is not a small cleaning task; it is evidence that the panel’s cardiology tag has drifted and needs source-level review.

Patient audiences are a different problem entirely

Condition claims, consent scope, and why recruiting patients through a general panel is fragile. Patient research cannot be treated as consumer research with a medical questionnaire attached.

A respondent can claim a diagnosis, but self-reported diagnosis is vulnerable to misunderstanding, outdated information, caregiver response, and outright misrepresentation. “I have diabetes” may mean type 1, type 2, gestational diabetes, prediabetes, or a family history. “I take a biologic” may refer to a prescribed therapy, a sample, a discontinued treatment, or a drug the respondent believes they received. For studies that depend on diagnosis, treatment history, disease severity, or care pathway, these ambiguities are not details; they are the study.

Consent is the second boundary. A patient may consent to a general market-research panel, but that does not automatically mean they consent to have their condition verified against clinical records, contacted about a specific therapeutic area, or asked to upload documentation. In many markets, health information receives heightened protection. A provider must distinguish between: permission to ask health questions; permission to use health data for targeting; permission to contact the person about a condition; and permission to verify a claim through a third party. These are separate permissions, not one checkbox.

Recruiting patients through a general panel is fragile because incidence is low and condition-specific eligibility is hard to validate. Suppose a study needs 150 people with moderate-to-severe atopic dermatitis currently using or recently prescribed a systemic therapy. A general consumer panel may identify people who select “eczema,” but many will have mild disease, self-diagnosed symptoms, historical childhood eczema, or another dermatological condition. The viable route is usually a combination of condition-aware sourcing, careful patient-type screening, caregiver exclusion where required, and documented consent—rather than broad blasting a general panel and hoping the diagnosis questions sort it out.

Where the money in a healthcare quote goes

Decompose the cost the way a CPI quote should be read: not as one number for “a doctor,” but as a sequence of paid activities that convert a broad claim into a usable research participant.

Start with incidence. If the brief requires a rare specialty, recent treatment involvement, and a minimum patient volume, the eligible share of starts may be low. Imagine 2,000 panel starts produce 500 clinician-role claims, 220 pass licence or registry validation, 90 confirm current relevant clinical practice, and 50 meet the full disease-area and patient-volume criteria. The final incidence is 2.5%—not because the panel is small, but because each additional requirement removes a distinct group.

Then add verification cost. A simple consumer study may need only a device and fraud check. A healthcare study may need licence or registry validation, professional-network corroboration, manual document review in markets where automated checks are weak, revalidation for repeat participants, and analyst time to reconcile conflicting evidence. If direct incentive is ¥25,000 per completed physician interview and verification, manual review, and re-approach add ¥8,000 per delivered interview, verification is nearly one third of the quoted CPI before panel margin, recruitment, or fieldwork management.

Incentive

What it buys: Clinician time and opportunity cost.

Illustrative effect: ¥1,250,000 for 50 completes at ¥25,000 each.

Screening and qualification

What it buys: Correct role, specialty, recency, and patient exposure.

Illustrative effect: Approximately four times more starts than final completes.

Verification

What it buys: Evidence that the credential and current role are real.

Illustrative effect: ¥400,000 at ¥8,000 per delivered complete.

Manual review and exceptions

What it buys: Handling borderline, incomplete, or conflicting records.

Illustrative effect: The work is often concentrated in a small number of markets.

Project management

What it buys: Quota control, re-contacts, documentation, and an audit trail.

Illustrative effect: Prevents silent substitution of easier audiences.

The practical implication for buyers is to ask for the cost decomposition, not only the CPI. A quote that appears expensive may be efficient if it includes verification and low substitution risk. A quote that appears cheap may simply be postponing the cost until the client discovers, during analysis, that the “prescribers” were mostly non-prescribing influencers.

What we will not sell

The audiences we decline and the reason. Saying no here is the credential.

We will not sell an audience as “verified specialists” when the only evidence is a self-reported specialty selection. We will not imply that a licence check proves current clinical practice. We will not offer a patient audience when the required condition, treatment status, or consent scope cannot be validated to the standard the study design demands. And we will not quietly substitute an adjacent professional—say, a nurse practitioner for a dermatologist, or a formulary pharmacist for a prescribing physician—without naming the substitution and obtaining approval.

There are also audiences where the honest answer is that no general research panel should be recruiting. Studies involving children, acute psychiatric crises, terminal illness, recent major medical events, or highly sensitive disclosures require ethics review, clinical governance, caregiver or guardian involvement, and consent procedures that exceed ordinary panel operations. A general market-research panel can sometimes support carefully designed, non-sensitive patient-experience work, but it should not be the default channel for research that depends on clinical records, vulnerable populations, or high-risk therapeutic decisions.

Refusal is not a sales weakness; it is the quality control. A credible healthcare-sample partner should be able to say: “We can deliver this audience, but only with these definitions, this evidence standard, and these limitations.” If a provider cannot explain what was verified, what remains self-reported, and what happens when evidence conflicts, the low price is not a discount. It is the cost of finding out later.

Filed under Sampling and reach

Who wrote this

OpinionReady Method Desk — Panel operations and data quality

The people who run the exchange day to day — supply operations, quality review and the payout queue. These notes come out of work we had to do anyway, written down because the same questions keep arriving from buyers and from members.

Written from our own operating record: the screening calls, field estimates and payout runs described here are ones we make on this exchange, not secondhand summaries of research done elsewhere.

More on sampling and reach

Everything on this topic