Methodology
How our vendor analysis works
01
Why this analysis exists
See the problem
Condition maps
With early customersFind the options
Options guides and comparisons
With early customersCheck the vendor
Vendor analysis
LiveMeasure results
Results measurement
Coming soon
02
What a report is, and what it is not
A report analyzes one capability of one vendor through one buyer profile: one of eight generalized profiles, or your own population's figures. No claims data is needed. It has five parts, each answering one question.
A report does not tell you whether to buy, rank the vendor or compare it with others. It shows where to look hardest, and the decision stays with you.
03
Our approach: curated evidence and written judgment
Many people can see a patient's lab results. The value is in knowing which results matter and what they mean for this patient. A vendor's materials and the published studies are largely open to anyone who looks; the work is in deciding which count as evidence and what they mean for you.
We are AI-enabled software that applies the same written method on each report. AI does the reading; scripts do the arithmetic; the method and the checks are actuarial.
Curated evidence
- Each fact sourced and dated
- Vendor claims labeled as the vendor's
- Studies screened for a sound comparison
Written judgment
- Written rules, applied the same way on each report
- Tested against judged cases
The vendor analysis
one vendor, one buyer profile
Only the buyer or the vendor knows
Contract terms and fees · How members would enroll · Unpublished results
Listed in the report as questions to ask
Your decision
04
Curation: where the evidence comes from
Evidence comes from the vendor's own materials, labeled vendor-stated; from documents the vendor presents about itself, such as security attestations and filings; and from independent published studies. Each fact is sourced and dated. Each study is labeled by who paid for it, how strong its design is and how closely it matches the program, and earns credit in proportion. A study credits a saving only if it has a sound comparison: a randomized design, or a credible comparison group with its starting point shown.
Vendor's own materials
Labeled vendor-statedClaims about results: shown and labeled, kept out of the estimate
shown in the report, not used in our estimate
Public record about the company
Each fact sourced and datedIndependent studies
Graded: who paid, design, matchSound comparison?
randomized, or a credible comparison group
- Yes
- Can credit a saving
- No
- Shape only
shapes the scenarios
The report
Where evidence is missing, the report says so plainly rather than filling the gap.
05
Judgment: how the evaluation works
The evaluation rates a fixed set of clinical, financial and operational questions, each with its reason and its sources. Each claim of effect is read for the usual pitfalls: members who choose to join, high-cost members drifting back toward average, before-and-after comparisons with no comparison group, and engagement that drops off. The scrutiny level, Light, Moderate or Elevated, rises with the number of questions rated adverse, and a serious adverse finding on a question that weighs most for your type of organization sets it to Elevated. A flag beside the level says whether independent evidence tests the vendor's savings; it is a flag, not a veto.
From the evaluation
- How many questions are rated adverse
- A serious adverse finding on a question that weighs most for this type of buyer
Read alongside the level
How large and how reversible is your decision?
- Light
- Moderate
- Elevated
Flag beside the level
Does independent evidence test the vendor's savings?
A plan-wide change that is hard to unwind deserves close scrutiny whatever the level says; the level is set from the evaluation's findings.
A flag is not a veto: one adverse rating on whether savings can be credited to the vendor does not raise the level on its own.
06
Judgment: how the savings range is built
The range starts from how the program would produce a saving. Each figure about you comes from your buyer profile, labeled with its version. The range is a grid: your design choices, from light to aggressive, against how members and providers respond, high, base and low; the headline is the middle package under the base response. Credit comes only from studies with a sound comparison, with each adjustment to your plan stated. Vendor claims are shown, not used. Real savings are kept apart from cost shifted to members, and figures are before fees. Where the design or the evidence doesn't support a number, the report says so in a plain section instead. Each estimate names a result in your own claims that would show it wrong.
Rows · Your design choicesColumns · How members and providers respond | High | Base | Low |
|---|---|---|---|
| Lightbroad, voluntary | |||
| Standardthe middle package | Headline | ||
| Aggressivenarrower, firmer |
Real savings
what the plan stops paying
Cost shifted to members
kept apart, not counted as a saving
Each figure states its year and its assumptions.
Each figure names a result in your own claims that would show it was wrong.
07
How we keep it honest
08
Limits
An analysis is a well-founded starting point for your decision, not a certified verdict.
09
Questions we hear
Can an analysis built on public information be trusted?
For the first question a buyer faces, whether a vendor's claims hold up, the important evidence is public. The claims are in the vendor's own materials, and independent evidence on programs like this one, peer-reviewed studies and independent evaluations, is often published even when no study tests this vendor; where none does, the report says so, which a buyer should know. A vendor's private data is usually what its own return-on-investment figures rest on, and independent actuaries have pointed out that employers have good reason not to rely on those alone. What we add is the work of finding that evidence, sorting the independent from the vendor-stated, judging how closely each study matches the program, and applying the same written method to each vendor.What can't public information tell you?
Some things only the buyer or the vendor knows: contract terms and fees, how the buyer's members would actually enroll, and results the vendor hasn't published. We don't treat those as known. The report lists them as questions to ask; where an estimate needs one, such as how many members would enroll, it uses a stated assumption drawn from evidence on similar programs and names the buyer's own figure that would replace it. Savings are given as a range before fees, with a plain note instead of a number where the evidence doesn't support one. Each estimate names a result in the buyer's own claims that would show it wrong, so it can be tested with the buyer's data later.
Get started
See the method applied to a vendor you're weighing.
No pay to play: we take no money from vendors, and who asks for our work doesn't change what it says.