Scientific deep-dive

Comparing Trials That Never Met

We refused a cross-trial comparison in an earlier article. This article runs the methodologically proper version of it, and explains why it appears to contradict a head-to-head trial without actually doing so.

By Nora Bissett · Pricing Editor
Editorially reviewed. Not medical advice · How we verify contentLast reviewed
7 min read·2 citations

We recently refused to compare two obesity drugs across separate trials, and explained why that is not a comparison.[1] A new paper does the methodologically proper version of what we refused: an anchored indirect treatment comparison, using individual patient data. It is better than lining two headlines up. It is still not a head-to-head, and one of its numbers has a confidence interval spanning a factor of nearly fifty.

What an anchored comparison does

The problem with reading across two trials is that the participants differ. If one enrolled heavier people, or more women, or people with worse blood sugar, then the difference between the headline figures partly measures the difference between the populations.

An anchored comparison exploits the fact that both trials contained a placebo arm. Instead of comparing drug A’s result to drug B’s, it compares each drug to its own placebo group, and then compares those two differences. The placebo arms act as a shared reference point (the anchor), which cancels out a great deal of what makes the trials incomparable.

This analysis went further. It had the individual patient records from one trial and only summary figures from the other, and used that to statistically reweight the first population to resemble the second on sex, body weight and blood sugar status. That is a real methodological step up from arithmetic on two press releases. (The simpler, unadjusted version of the method is what compared the Wegovy pill with the Wegovy shot: Wegovy pill vs injection.)

An anchored comparison measures each drug against its own trial’s placebo group, then compares the two differences.

What it found

Oral semaglutide 25 mg against orforglipron 36 mg, in adults with overweight or obesity and without diabetes.[2]
OutcomeResult95% CI
Weight change (treatment-regimen estimand)−3.2 percentage points favoring semaglutide−5.9 to −0.4
Weight change (efficacy estimand)−3.0 percentage points favoring semaglutide−5.8 to −0.3
Stopped for any adverse eventOdds ratio 4.1, favoring semaglutide1.3 to 13.0
Stopped for gastrointestinal eventsOdds ratio 13.9, favoring semaglutide2.0 to 96.0
Look at that last interval before quoting the number in front of it. It runs from 2.0 to 96.0, a range spanning a factor of nearly fifty. The data are compatible with orforglipron doubling the odds of stopping for gastrointestinal side effects, and also with multiplying those odds ninety-six times. An interval that wide tells you the direction and almost nothing about the size.

The weight difference is on firmer footing: about three percentage points, with intervals that stay comfortably on one side of zero, and consistent across both ways of analyzing it.

It seems to contradict a head-to-head trial. It does not.

A reader who followed our coverage of ACHIEVE-3 will notice a problem. That was an actual randomized head-to-head between these same two drugs, and orforglipron won. Here oral semaglutide wins. It looks as if both cannot be right, but they are measuring different things.

Why the two results are not in conflict.
ACHIEVE-3This comparison
DesignRandomized head-to-headIndirect, via placebo arms
OutcomeHbA1c (blood sugar)Body weight
Semaglutide dose7 mg and 14 mg25 mg
PopulationType 2 diabetes on metforminObesity, without diabetes

The two differ in outcome, in semaglutide dose (nearly twice as high here) and in population. These are two answers to two questions, and neither refutes the other. What would settle the weight question is the trial nobody has run: these two drugs, at these doses, randomized against each other, in this population.

On one point the two agree: orforglipron produced more discontinuation for side effects in both. ACHIEVE-3 recorded roughly double, and this comparison points the same way. Agreement across two independent designs is stronger evidence than either provides on its own.

What still limits it

  • It is not a head-to-head. Anchoring removes much of the population difference and cannot remove differences in how the trials were run, who dropped out, or what care participants received alongside.
  • Adjustment only covers what was measured. Sex, weight and glycemic status were balanced. Whatever else differed was not.
  • Several authors work for Novo Nordisk, which makes oral semaglutide, and the comparator is a competitor’s drug. That is disclosed and ordinary, and still worth knowing.
  • The tolerability estimate is barely constrained, as the interval above shows.

Our position from the earlier article stands, slightly refined. A cross-trial comparison assembled by a reader from two headlines is not evidence. A properly anchored, population-adjusted comparison published with its confidence intervals is evidence: weaker than a randomized head-to-head, stronger than nothing, and only as good as the intervals it reports.

Frequently Asked Questions

An indirect comparison found oral semaglutide 25 mg produced about three percentage points more weight loss than orforglipron 36 mg in adults with obesity and without diabetes. No trial has randomized these two drugs against each other for weight.
It did, for blood sugar, in people with type 2 diabetes, against semaglutide at 7 and 14 mg. This comparison is about weight, in people without diabetes, against 25 mg. The question, the dose and the population all differ, so the two do not contradict each other.
A method that compares each drug to its own trial's placebo group, then compares those two differences. The shared placebo reference cancels much of what makes separate trials incomparable, which naive cross-trial arithmetic cannot do.
The direction is consistent with the head-to-head trial, which is reassuring. The size is not. The odds ratio for gastrointestinal discontinuation is 13.9 with a confidence interval running from 2.0 to 96.0, which constrains very little.
More than lining up two headlines, less than a randomized head-to-head. They remain sensitive to differences between trials that adjustment cannot reach, and should be read with their confidence intervals rather than their point estimates.

References

  1. 1.Horn DB, Ryan DH, Kis SG, et al. Orforglipron, an oral small-molecule GLP-1 receptor agonist, for the treatment of obesity in people with type 2 diabetes (ATTAIN-2): a phase 3, double-blind, randomised, multicentre, placebo-controlled trial The Lancet. 2026. PMID: 41275875.
  2. 2.Michalak W, Bøg M, Bendixen T, et al. Oral Semaglutide 25 mg Versus Orforglipron 36 mg in Obesity: A Population-Adjusted Indirect Treatment Comparison Diabetes, Obesity and Metabolism. 2026. PMID: 42225305.

Wegovy Pill vs Injection: Is the Pill as Good as the Shot?

The Wegovy pill cut weight 13.6% in its trial and the shot 14.9% in its own, and an indirect comparison could not tell them apart. What differs: the daily fasting rule, the dose steps, side effects, the 7.2 mg pen and about $50 a month.

10 min read

Rybelsus for Weight Loss: How Much Weight People Lose, and Why It's Less

Rybelsus is approved for type 2 diabetes, not weight. In its trials the 14 mg dose took off 3.1 to 4.4 kg in 26 weeks. Why the Wegovy pill does far more, what is known in people without diabetes, and why insurers won't cover it for weight.

10 min read

An Oral Pill in a Diabetes Population

Over 72 weeks a daily tablet took 9.6% off the scale for people carrying obesity alongside type 2 diabetes. Why we will not set that figure beside the injectable trials.

7 min read

The First Pill-Versus-Pill Trial

Orforglipron beat oral semaglutide on HbA1c at every dose pairing in 1,698 adults, and produced twice the dropouts and three times the heart rate rise. Both halves are the result.

8 min read

The Drugs That Are Not Here Yet

Four investigational molecules have published human results. The most striking figure among them, 8% of body weight in four weeks, comes from the earliest and smallest study of the four.

8 min read

The Statistic That Asks If Groups Differ

A SOUL secondary analysis found oral semaglutide cutting heart-failure events in people who had heart failure and doing nothing in those who did not. The test of whether that split is real came out at P = .06.

7 min read

Where to get GLP-1 online, safely: sellers our editors have checked

These are telehealth sellers our editors have checked. For each one we hold a price, the form the drug comes in, and the states it reaches.

No insurance needed · vetted by our editors

Some of the links on this page earn us money. If you sign up with a provider after following one, that provider may pay GLP Watchdog a commission. Learn more

7.9

Luvo Health

Moving between compounded and brand without changing seller

6.3

WellMedRx

Comparing compounded and brand GLP-1 plans with a published state list

9.1

Collective

Flat any-dose pricing, if you can absorb a $199 annual membership on top

From $59/mo + membership

Get started →
Read full review →

About this analysis

GLP Watchdog publishes independently. Each seller in our dataset is checked against that seller's own website, and the dataset is updated continuously. Read our full methodology →