Scientific deep-dive
Comparing Trials That Never Met
We refused a cross-trial comparison in an earlier article. This article runs the methodologically proper version of it, and explains why it appears to contradict a head-to-head trial without actually doing so.
We recently refused to compare two obesity drugs across separate trials, and explained why that is not a comparison.[1] A new paper does the methodologically proper version of what we refused: an anchored indirect treatment comparison, using individual patient data. It is better than lining two headlines up. It is still not a head-to-head, and one of its numbers has a confidence interval spanning a factor of nearly fifty.
What an anchored comparison does
The problem with reading across two trials is that the participants differ. If one enrolled heavier people, or more women, or people with worse blood sugar, then the difference between the headline figures partly measures the difference between the populations.
An anchored comparison exploits the fact that both trials contained a placebo arm. Instead of comparing drug A’s result to drug B’s, it compares each drug to its own placebo group, and then compares those two differences. The placebo arms act as a shared reference point (the anchor), which cancels out a great deal of what makes the trials incomparable.
This analysis went further. It had the individual patient records from one trial and only summary figures from the other, and used that to statistically reweight the first population to resemble the second on sex, body weight and blood sugar status. That is a real methodological step up from arithmetic on two press releases. (The simpler, unadjusted version of the method is what compared the Wegovy pill with the Wegovy shot: Wegovy pill vs injection.)
An anchored comparison measures each drug against its own trial’s placebo group, then compares the two differences.
What it found
| Outcome | Result | 95% CI |
|---|---|---|
| Weight change (treatment-regimen estimand) | −3.2 percentage points favoring semaglutide | −5.9 to −0.4 |
| Weight change (efficacy estimand) | −3.0 percentage points favoring semaglutide | −5.8 to −0.3 |
| Stopped for any adverse event | Odds ratio 4.1, favoring semaglutide | 1.3 to 13.0 |
| Stopped for gastrointestinal events | Odds ratio 13.9, favoring semaglutide | 2.0 to 96.0 |
The weight difference is on firmer footing: about three percentage points, with intervals that stay comfortably on one side of zero, and consistent across both ways of analyzing it.
It seems to contradict a head-to-head trial. It does not.
A reader who followed our coverage of ACHIEVE-3 will notice a problem. That was an actual randomized head-to-head between these same two drugs, and orforglipron won. Here oral semaglutide wins. It looks as if both cannot be right, but they are measuring different things.
| ACHIEVE-3 | This comparison | |
|---|---|---|
| Design | Randomized head-to-head | Indirect, via placebo arms |
| Outcome | HbA1c (blood sugar) | Body weight |
| Semaglutide dose | 7 mg and 14 mg | 25 mg |
| Population | Type 2 diabetes on metformin | Obesity, without diabetes |
The two differ in outcome, in semaglutide dose (nearly twice as high here) and in population. These are two answers to two questions, and neither refutes the other. What would settle the weight question is the trial nobody has run: these two drugs, at these doses, randomized against each other, in this population.
On one point the two agree: orforglipron produced more discontinuation for side effects in both. ACHIEVE-3 recorded roughly double, and this comparison points the same way. Agreement across two independent designs is stronger evidence than either provides on its own.
What still limits it
- It is not a head-to-head. Anchoring removes much of the population difference and cannot remove differences in how the trials were run, who dropped out, or what care participants received alongside.
- Adjustment only covers what was measured. Sex, weight and glycemic status were balanced. Whatever else differed was not.
- Several authors work for Novo Nordisk, which makes oral semaglutide, and the comparator is a competitor’s drug. That is disclosed and ordinary, and still worth knowing.
- The tolerability estimate is barely constrained, as the interval above shows.
Our position from the earlier article stands, slightly refined. A cross-trial comparison assembled by a reader from two headlines is not evidence. A properly anchored, population-adjusted comparison published with its confidence intervals is evidence: weaker than a randomized head-to-head, stronger than nothing, and only as good as the intervals it reports.
Frequently Asked Questions
References
- 1.Horn DB, Ryan DH, Kis SG, et al. Orforglipron, an oral small-molecule GLP-1 receptor agonist, for the treatment of obesity in people with type 2 diabetes (ATTAIN-2): a phase 3, double-blind, randomised, multicentre, placebo-controlled trial The Lancet. 2026. PMID: 41275875.
- 2.Michalak W, Bøg M, Bendixen T, et al. Oral Semaglutide 25 mg Versus Orforglipron 36 mg in Obesity: A Population-Adjusted Indirect Treatment Comparison Diabetes, Obesity and Metabolism. 2026. PMID: 42225305.
Compare the sellers
Related research
Wegovy Pill vs Injection: Is the Pill as Good as the Shot?
The Wegovy pill cut weight 13.6% in its trial and the shot 14.9% in its own, and an indirect comparison could not tell them apart. What differs: the daily fasting rule, the dose steps, side effects, the 7.2 mg pen and about $50 a month.
10 min read
Rybelsus for Weight Loss: How Much Weight People Lose, and Why It's Less
Rybelsus is approved for type 2 diabetes, not weight. In its trials the 14 mg dose took off 3.1 to 4.4 kg in 26 weeks. Why the Wegovy pill does far more, what is known in people without diabetes, and why insurers won't cover it for weight.
10 min read
An Oral Pill in a Diabetes Population
Over 72 weeks a daily tablet took 9.6% off the scale for people carrying obesity alongside type 2 diabetes. Why we will not set that figure beside the injectable trials.
7 min read
The First Pill-Versus-Pill Trial
Orforglipron beat oral semaglutide on HbA1c at every dose pairing in 1,698 adults, and produced twice the dropouts and three times the heart rate rise. Both halves are the result.
8 min read
The Drugs That Are Not Here Yet
Four investigational molecules have published human results. The most striking figure among them, 8% of body weight in four weeks, comes from the earliest and smallest study of the four.
8 min read
The Statistic That Asks If Groups Differ
A SOUL secondary analysis found oral semaglutide cutting heart-failure events in people who had heart failure and doing nothing in those who did not. The test of whether that split is real came out at P = .06.
7 min read
Where to get GLP-1 online, safely: sellers our editors have checked
These are telehealth sellers our editors have checked. For each one we hold a price, the form the drug comes in, and the states it reaches.
No insurance needed · vetted by our editors
Some of the links on this page earn us money. If you sign up with a provider after following one, that provider may pay GLP Watchdog a commission. Learn more
Luvo Health
Moving between compounded and brand without changing seller
From $179/mo
Get started →WellMedRx
Comparing compounded and brand GLP-1 plans with a published state list
From $49/mo
Get started →Collective
Flat any-dose pricing, if you can absorb a $199 annual membership on top
From $59/mo + membership
Get started →