Methodology
Evidence Standard
Structured rules for evidence types, metadata, verification, and publication.
Use this standard when adding evidence to an Allocate finding or case study. It describes the labels, metadata, review states, and citation details needed for another person to check the work.
Scope
This standard defines the minimum structure required for evidence used in Allocate findings, case studies, and human-grounded investigations.
It applies to:
- agent-collected desk research
- linked public records and open datasets
- community-submitted field evidence
- editor-written synthesis and recommendations
Evidence types
Allocate evidence should be labeled with one primary type:
| Type | Description | Example |
|---|---|---|
literature | Peer-reviewed research or formal institutional analysis | Open-access journal paper, World Bank report |
administrative_record | Official public records or government data | Budget PDF, permit filing, agenda packet |
operational_record | Service or implementation evidence | Construction notice, route schedule, maintenance map |
observation | Direct place-based observation | Street audit, field note, repeat count |
media | Visual or audio artifact tied to a claim | Photo of blocked bike lane, flood video |
testimony | Statement from a person with local knowledge | Resident interview, organizer statement |
measurement | Structured count or reading using a stated method | Traffic count, curb occupancy tally |
inference | Editor or agent synthesis across sources | Cost barrier inferred from land values and budget gaps |
If a source fits multiple categories, use the one that best reflects how the claim is being supported.
Required metadata
Every evidence item should include:
| Field | Requirement |
|---|---|
title | Short human-readable label |
source_type | One of the allowed evidence types |
date | Publication date or collection date |
location | Geographic scope or exact place if safe to disclose |
collector | Agent, contributor, agency, or publication |
method | How the evidence was obtained |
firsthand | true if directly observed or collected |
citation | URL, document reference, or artifact link |
sensitivity | public, limited, or sensitive |
Preferred additional fields:
time_rangeconfidence_noterepeat_observationrelated_claim_idslanguagelimitations
Claim rules
Evidence supports a claim. Writers still decide how broad and precise the final claim should be.
Writers and agents should distinguish between:
- what was directly observed
- what was reported by a source
- what is established by a document
- what is inferred from several facts
A report needs additional support before it turns testimony or a single observation into a broad causal statement.
Verification states
Every evidence item has a visible verification state:
| State | Meaning |
|---|---|
unreviewed | Newly added and not checked yet |
structured | Metadata complete and type labeled correctly |
corroborated | Supported by another source, repeat observation, or linked artifact |
reviewed | Checked by a human reviewer or editor |
high_confidence | Strongly supported and suitable for decision-critical findings |
Verification state and confidence answer different questions. Keep both fields.
Confidence rubric
| Confidence | Standard |
|---|---|
low | Single-source, weak metadata, unclear method, or unresolved conflict |
medium | Good metadata, plausible method, some corroboration |
high | Multiple independent supports, strong method, low ambiguity |
A claim should never be marked high confidence if the underlying evidence still depends on one fragile source.
Publication threshold
Publish a claim as a finding only after it has:
- a clear proposition
- at least one linked source or artifact
- enough metadata to audit where it came from
- a claim state
- a confidence label
- reviewer signoff if the claim materially affects recommendations
Decision-critical claims should usually have at least two independent supports. A definitive source can satisfy that requirement on its own.
Privacy and safety
Evidence handling accounts for risk as well as truth value.
Caution
Do not publish:
- personally identifying information without a clear reason and consent
- precise locations when disclosure could endanger residents or workers
- imagery of minors or vulnerable people without strong justification
- evidence collected through trespass or unsafe instructions
Sensitive evidence may inform internal review. A separate publication decision is required before it becomes public.
Citation format
Allocate writing should prefer short, verifiable citations over vague references.
Minimum citation guidance:
- use direct URLs for open web sources
- identify the publisher or responsible entity
- include year when known
- note if the source is archived, inaccessible, or secondhand
- identify whether a claim is an inference or a direct source statement
Citations provide attribution and make the research reproducible.