Process

Research process

A staged process for fair public-interest analysis, not a rush to publication.

Observed uses a staged process to move from an initial public-interest question to evidence checking, research development, benchmark comparison, right of response and publication review. The same process can identify concern signals, improvement signals or strong-practice signals where the public evidence supports it. Each stage is a quality gate, not just a task list.

Process overview

Three questions guide the process.

The detailed work changes by matter, but the process always tests fit, evidence strength and publication fairness before any public-facing output is considered. That applies to accountability concerns, improvement patterns and positive-practice recognition.

1

Does the matter fit?

The first test is whether the issue fits Observed’s public-interest purpose, organisational focus, evidence model and ethical boundaries. This may include concern signals, improvement signals or strong-practice signals.

2

Does the evidence support it?

The second test is whether lawful public signals exist, whether they come from suitable source types and whether they support concern, improvement or positive-practice analysis.

3

Can it be published fairly?

The final test is whether the analysis remains source-cited, benchmarked, proportionate, response-aware and within the legal boundaries. Observed avoids unsupported criticism and unsupported praise.

Balanced analysis

Observed can identify concern, improvement or strong practice.

Accountability is not only about failure. A disciplined public-interest model should also be able to recognise responsible conduct, clear governance, benchmark alignment and meaningful improvement when the public evidence supports that conclusion.

!

Concern signals

Public evidence may indicate a possible gap between organisational claims, stakeholder experience, recognised standards and observable conduct.

Improvement signals

Public evidence may show that an organisation is responding, adapting, strengthening governance or improving practice over time.

Strong-practice signals

Public evidence may support recognition where organisational behaviour appears aligned with academic benchmarks, good-practice standards and public-interest expectations.

Possible outcomes

Not every signal becomes a report.

A careful process needs clear stop points. Observed may proceed only where the matter fits the purpose, the evidence supports the analysis and publication remains proportionate, whether the finding is critical, neutral or positive.

1
Proceed The matter moves to the next stage because public-interest relevance, evidence fit and risk controls are sufficient.
2
Hold or narrow The issue is paused or reduced to what the public evidence can responsibly support.
3
Decline Observed does not proceed where there is no public-interest basis, insufficient evidence, bad-faith motive or unacceptable risk.
4
Refer elsewhere A regulator, legal advisor, safety pathway, union or employment process may be more appropriate.
5
Recognise positive practice The matter may proceed as a positive-practice review where public evidence aligns with recognised standards and the public-interest threshold is clear.
6
Watchlist The matter may be retained for future sector-level research where named-organisation analysis is not justified.
Process stages

From public-interest question to publication decision.

The process applies to platform-led research, client-initiated requests and commissioned research. The same evidence, ethics, privacy, legal and human-review gates apply whether the output identifies concern, improvement or strong practice.

Stage 0

Initial question and fit assessment

This stage determines whether the issue belongs within Observed’s purpose and evidence model. It screens for public-interest relevance, organisational behaviour focus, plausible public evidence, bad-faith motive, privacy risk and safety risk. Positive-practice requests are screened with the same discipline as concern-based requests.

Purpose Decide whether the matter fits Observed’s model.
Activities Identify the issue, screen motive and assess public-interest relevance.
Outcome Proceed, hold, decline, refer elsewhere or add to watchlist.
Stage 1

Evidence check

This stage tests whether publicly available signals exist and whether they are sufficient to justify deeper benchmark analysis. It looks at source types, signal categories, source diversity, evidence gaps and balancing material, including material that may support concern, improvement or strong-practice findings.

Purpose Confirm whether structured analysis is evidence-supported.
Deliverable Evidence check with recommendation and evidence-gap notes.
Threshold Enough public material to support benchmark comparison.
Stage 2

Research development and information-gap work

This stage strengthens the evidence base before full analysis. It may include deeper source research, timeline development, source registers and information-gap work. Public-information request drafts, including official information request pathways, belong here where relevant. The aim is to test the pattern, not to force a negative or positive conclusion.

Purpose Strengthen the evidence base before benchmark comparison.
Activities Source research, timeline work, source register and information-gap planning.
Threshold Evidence base is lawful, broad and strong enough for analysis.
Stage 3

Benchmark comparison and pattern analysis

This is the core analysis stage. Classified public signals are compared against peer-reviewed academic frameworks and recognised good-practice standards. The analysis identifies alignment, divergence, confidence ratings, limitations, accountability questions, improvement indicators and strong-practice indicators where supported.

Purpose Compare public signals against independent benchmarks.
Deliverable Organisation-specific analysis, sector pattern analysis or positive-practice review.
Threshold Sources classified, benchmarks cited and limits clear.
Stage 4

Right of response and publication review

This stage ensures that a named organisation has a fair opportunity to respond before publication where required. Proposed findings or questions are shared with an appropriate organisational contact, and the response is considered before any publication decision is made. This applies to critical findings and to positive-practice recognition where the organisation should have an opportunity to confirm, clarify or correct the public record.

Purpose Provide a fair response opportunity before named publication.
Activities Right-of-response letter, response record and evidence updates.
Threshold Response window closed and proportionality assessed.
Stage 5

Publication and distribution

This stage publishes and distributes findings in formats appropriate to the evidence, audience and public-interest purpose. Publication may include a report, article, executive summary, stakeholder briefing, media backgrounder, infographic copy, recognition profile or distribution pack.

Purpose Publish only where evidence and review gates support it.
Outputs Report, article, briefing, recognition profile, media backgrounder or distribution pack.
Boundary Comparative, source-cited, benchmarked and proportionate.

Publication requires more than a signal.

The process is deliberately built around safeguards that prevent weak, narrow or disproportionate material from becoming public-facing analysis. The same safeguards apply to concern-based reports and positive-practice recognition.

Public-interest fit

The issue must concern organisational behaviour, public accountability, stakeholder harm, public trust, improvement or strong public-interest practice, not a purely private dispute.

Evidence sufficiency

Public signals must be lawful, attributable, relevant and strong enough to justify analysis or recognition.

Privacy scan

Privacy obligations are considered against the New Zealand Privacy Act principles.

Human review

No named-organisation output leaves the system without human review and sign-off.

The process can stop, narrow or change direction at any point.

Named-organisation findings are suppressed unless signals are drawn from enough independent source types. Multiple anonymous reviews alone do not meet the threshold, regardless of volume. Positive-practice recognition is also withheld unless public evidence, benchmark alignment and source consistency support it. Where the threshold is not met, the matter may be held, declined, referred elsewhere, used only as background context for a sector-level pattern, or added to a watchlist.

Publication boundary

Observed publishes comparisons, not verdicts or endorsements.

Published content must remain comparative, source-cited, benchmarked, confidence-rated, proportionate and legally reviewed where required. It may identify risk, improvement or strong practice, but only within the limits of the evidence.

It must not become unsupported allegation, reputational attack, revenge content, inflammatory campaign material, personal targeting, unsupported promotion or content that goes beyond the available evidence.

The organisation may be named. The verdict is not asserted. The benchmark does the work.

Request analysis

Have a public-interest question that may fit the process?

Observed can assess whether an issue, concern, improvement pattern or example of strong practice has public-interest relevance, a lawful public evidence base and enough source diversity to justify deeper research.

Observed does not provide legal advice and does not act as a private investigator. All outputs are based on publicly available, lawfully accessible information, benchmark comparison and human review. The process is designed to avoid both unsupported allegation and unsupported endorsement.