ESSAY № 014·4 MINUTES·DECEMBER 2025

Running 100 Experiments a QuarterA Framework

Velocity matters. Here's how high-performing growth teams run experiments at scale without sacrificing quality or learning.

The best growth teams ship 50-100 experiments per quarter. Not because they're reckless, but because they've built systems that make experimentation efficient. Here's how.

The Experiment Velocity Equation

Velocity = (Ideas × Execution Speed) / Analysis Time

To increase velocity, you need:

  1. A full pipeline of ideas
  2. Fast implementation
  3. Efficient analysis

Most teams optimize only one of these and wonder why they're still slow.

Building the Idea Pipeline

Continuous Ideation

Don't brainstorm in batches. Collect ideas continuously:

  • Weekly idea submissions from the team
  • Customer feedback and support tickets
  • Competitive observation
  • Data anomaly investigations
  • Cross-functional input

The Idea Backlog

Maintain a scored backlog. For each idea, estimate:

  • Impact: How much could this move the metric?
  • Confidence: How sure are we about the impact?
  • Effort: How long to implement?

ICE score = (Impact × Confidence) / Effort

Weekly Prioritization

Every week, review the top 10-20 ideas and select 3-5 to execute. Don't over-plan — adjust as you learn.

Fast Experiment Implementation

Pre-Built Components

Create reusable experiment components:

  • Modal templates
  • Banner templates
  • Email templates
  • Landing page templates
  • Feature flag wrappers

Experiment Tooling

Invest in tools that reduce implementation time:

  • Feature flag platform (LaunchDarkly, Statsig)
  • No-code testing tool (Optimizely, VWO)
  • Experiment tracking database
  • Statistical significance calculators

Dedicated Engineering

Growth without engineering is growth theater. Dedicated growth engineers who understand experimentation are non-negotiable.

Time-Boxing

Not every experiment needs full design review. Create tiers:

  • Tier 1: High visibility, needs full process (1-2 weeks)
  • Tier 2: Medium visibility, expedited review (3-5 days)
  • Tier 3: Low visibility, ship and monitor (1-2 days)

Efficient Analysis

Pre-Registration

Before launching, document:

  • Hypothesis
  • Primary metric
  • Secondary metrics (guardrails)
  • Sample size required
  • Expected runtime
  • Decision criteria

This prevents post-hoc rationalization and speeds up analysis.

Automated Dashboards

Build dashboards that auto-populate:

  • Experiment performance vs. control
  • Sample size progress
  • Statistical significance
  • Segment breakdowns

Checking results should take minutes, not hours.

Weekly Experiment Review

Dedicate a weekly meeting to:

  • Review completed experiments
  • Make ship/kill decisions
  • Document learnings
  • Discuss surprising results

The Learning Repository

Every experiment produces learnings, even losers. Document:

  • What we tested
  • What we expected
  • What happened
  • Why we think it happened
  • What we'll do differently

The Experiment Operating Rhythm

Monday: Prioritization

  • Review idea backlog
  • Select experiments for the week
  • Assign ownership

Tuesday-Thursday: Execution

  • Design and build experiments
  • Launch when ready
  • Monitor active experiments

Friday: Review

  • Check experiment progress
  • Review concluded experiments
  • Document learnings
  • Submit new ideas

Common Velocity Killers

  • Over-designing: Not every test needs pixel-perfect design.
  • Committee approval: Reduce approvers, increase accountability.
  • Perfect data: 80% accurate data now beats 99% accurate data next month.
  • Feature creep: Test the minimum, not the maximum.
  • Fear of failure: Expect 70% of experiments to lose. That's learning.

Quality vs. Velocity

More experiments doesn't mean worse experiments. Quality comes from:

  • Proper sample sizes (don't stop early)
  • Correct metrics (measure what matters)
  • Learning documentation (capture the insight)
  • Iteration (winners lead to more experiments)

Speed without these is just chaos.


Running 100 experiments a quarter isn't about working harder — it's about removing friction. Every day an idea sits in backlog, every hour spent on unnecessary approval, every experiment killed by lack of engineering — that's wasted growth potential.

Cite as · Magnuson 2025 · Omega Point Writing № 014Experimentation · Growth Process · Velocity