# Comparing Trials That Never Met

By Nora Bissett, Pricing Editor (https://glpwatchdog.org/authors/nora-bissett) | Published: 2026-08-20 | Updated: 2026-10-27

Canonical page: https://glpwatchdog.org/research/comparing-trials-that-never-met

> We refused a cross-trial comparison in an earlier article. This article runs the methodologically proper version of it, and explains why it appears to contradict a head-to-head trial without actually doing so.

## Key points

- Oral semaglutide 25 mg beat orforglipron 36 mg by ~3 percentage points of weight.
- The GI-discontinuation odds ratio is 13.9, with a CI from 2.0 to 96.0.
- It seems to contradict ACHIEVE-3, and does not: different outcome, dose and population.
- Both agree that orforglipron caused more discontinuation. Agreement across designs is worth more.
- Several authors work for the maker of one of the two drugs.

We recently refused to compare two obesity drugs across separate trials, and explained why that is not a comparison.[1] A new paper does the methodologically proper version of what we refused: an anchored indirect treatment comparison, using individual patient data. It is better than lining two headlines up. It is still not a head-to-head, and one of its numbers has a confidence interval spanning a factor of nearly fifty.

## What an anchored comparison does

The problem with reading across two trials is that the participants differ. If one enrolled heavier people, or more women, or people with worse blood sugar, then the difference between the headline figures partly measures the difference between the populations.

An *anchored* comparison exploits the fact that both trials contained a placebo arm. Instead of comparing drug A’s result to drug B’s, it compares each drug to *its own placebo group*, and then compares those two differences. The placebo arms act as a shared reference point (the anchor), which cancels out a great deal of what makes the trials incomparable.

This analysis went further. It had the individual patient records from one trial and only summary figures from the other, and used that to statistically reweight the first population to resemble the second on sex, body weight and blood sugar status. That is a real methodological step up from arithmetic on two press releases. (The simpler, unadjusted version of the method is what compared the Wegovy pill with the Wegovy shot: [Wegovy pill vs injection](https://glpwatchdog.org/research/is-the-pill-as-good-as-the-shot).)

> An anchored comparison measures each drug against its own trial’s placebo group, then compares the two differences.

## What it found

*Oral semaglutide 25 mg against orforglipron 36 mg, in adults with overweight or obesity and without diabetes.[2]*

| Outcome | Result | 95% CI |
| --- | --- | --- |
| Weight change (treatment-regimen estimand) | −3.2 percentage points favoring semaglutide | −5.9 to −0.4 |
| Weight change (efficacy estimand) | −3.0 percentage points favoring semaglutide | −5.8 to −0.3 |
| Stopped for any adverse event | Odds ratio 4.1, favoring semaglutide | 1.3 to 13.0 |
| Stopped for gastrointestinal events | **Odds ratio 13.9**, favoring semaglutide | **2.0 to 96.0** |

> **Look at that last interval before quoting the number in front of it.** It runs from 2.0 to 96.0, a range spanning a factor of nearly fifty. The data are compatible with orforglipron doubling the odds of stopping for gastrointestinal side effects, and also with multiplying those odds ninety-six times. An interval that wide tells you the direction and almost nothing about the size.

The weight difference is on firmer footing: about three percentage points, with intervals that stay comfortably on one side of zero, and consistent across both ways of analyzing it.

## It seems to contradict a head-to-head trial. It does not.

A reader who followed our coverage of [ACHIEVE-3](https://glpwatchdog.org/research/the-first-pill-versus-pill-trial) will notice a problem. That was an actual randomized head-to-head between these same two drugs, and orforglipron won. Here oral semaglutide wins. It looks as if both cannot be right, but they are measuring different things.

*Why the two results are not in conflict.*

|   | ACHIEVE-3 | This comparison |
| --- | --- | --- |
| Design | **Randomized head-to-head** | Indirect, via placebo arms |
| Outcome | HbA1c (blood sugar) | **Body weight** |
| Semaglutide dose | 7 mg and 14 mg | **25 mg** |
| Population | Type 2 diabetes on metformin | **Obesity, without diabetes** |

The two differ in outcome, in semaglutide dose (nearly twice as high here) and in population. These are two answers to two questions, and neither refutes the other. What would settle the weight question is the trial nobody has run: these two drugs, at these doses, randomized against each other, in this population.

On one point the two agree: **orforglipron produced more discontinuation for side effects in both**. ACHIEVE-3 recorded roughly double, and this comparison points the same way. Agreement across two independent designs is stronger evidence than either provides on its own.

## What still limits it

- **It is not a head-to-head.** Anchoring removes much of the population difference and cannot remove differences in how the trials were run, who dropped out, or what care participants received alongside.
- **Adjustment only covers what was measured.** Sex, weight and glycemic status were balanced. Whatever else differed was not.
- **Several authors work for Novo Nordisk**, which makes oral semaglutide, and the comparator is a competitor’s drug. That is disclosed and ordinary, and still worth knowing.
- **The tolerability estimate is barely constrained**, as the interval above shows.

Our position from the earlier article stands, slightly refined. A cross-trial comparison assembled by a reader from two headlines is not evidence. A properly anchored, population-adjusted comparison published with its confidence intervals is evidence: weaker than a randomized head-to-head, stronger than nothing, and only as good as the intervals it reports.

## Frequently asked questions

### Is oral semaglutide better than orforglipron for weight loss?

An indirect comparison found oral semaglutide 25 mg produced about three percentage points more weight loss than orforglipron 36 mg in adults with obesity and without diabetes. No trial has randomized these two drugs against each other for weight.

### Didn't a head-to-head trial find orforglipron better?

It did, for blood sugar, in people with type 2 diabetes, against semaglutide at 7 and 14 mg. This comparison is about weight, in people without diabetes, against 25 mg. The question, the dose and the population all differ, so the two do not contradict each other.

### What is an anchored indirect comparison?

A method that compares each drug to its own trial's placebo group, then compares those two differences. The shared placebo reference cancels much of what makes separate trials incomparable, which naive cross-trial arithmetic cannot do.

### How reliable is the side-effect finding?

The direction is consistent with the head-to-head trial, which is reassuring. The size is not. The odds ratio for gastrointestinal discontinuation is 13.9 with a confidence interval running from 2.0 to 96.0, which constrains very little.

### Should indirect comparisons be trusted?

More than lining up two headlines, less than a randomized head-to-head. They remain sensitive to differences between trials that adjustment cannot reach, and should be read with their confidence intervals rather than their point estimates.

## References

1. Horn DB, Ryan DH, Kis SG, et al. Orforglipron, an oral small-molecule GLP-1 receptor agonist, for the treatment of obesity in people with type 2 diabetes (ATTAIN-2): a phase 3, double-blind, randomised, multicentre, placebo-controlled trial. The Lancet. 2026. PMID: 41275875. https://pubmed.ncbi.nlm.nih.gov/41275875/
2. Michalak W, Bøg M, Bendixen T, et al. Oral Semaglutide 25 mg Versus Orforglipron 36 mg in Obesity: A Population-Adjusted Indirect Treatment Comparison. Diabetes, Obesity and Metabolism. 2026. PMID: 42225305. https://pubmed.ncbi.nlm.nih.gov/42225305/

---

Cite as: GLP Watchdog, Nora Bissett, "Comparing Trials That Never Met", published 2026-08-20, updated 2026-10-27. https://glpwatchdog.org/research/comparing-trials-that-never-met

Canonical HTML page: https://glpwatchdog.org/research/comparing-trials-that-never-met

Medical disclaimer: Nothing here is medical advice. We report on this subject; we do not treat anyone. Whether to begin a medication, supplement, or treatment, whether to adjust it, and whether to stop are questions for a clinician licensed to answer them, who knows your history.
