Skip to content

Research

When does a shared AI capability beat every team doing it alone?

Companies are introducing, adopting and using AI team by team. Each team picks a tool, tests it, learns where it fails and trains its people. Often several teams pay for the same lesson. This research asks, with small models we can solve exactly, when it pays to learn that lesson once.

The scarce resource is not only GPUs. It is specialist time, compute or vendor budget: whatever the next block of AI work would use. Model training is one important case. Choosing a service, testing it on your own documents, teaching people to use it and keeping it working when the vendor changes it are others, and in most companies the larger ones.

The bottom line

A shared route loses through three doors: its cost, compulsion and incentives.

For a single planner, a shared route that teams may ignore, that costs nothing to use and that knows at least what each team knows cannot lower value. A team can always ignore it. So when a shared route loses, it loses because it costs something, because teams are forced through it, or because of how people respond to its rules.

That last door is the surprising one. Once people respond to the rules, the comfort of "an extra option cannot hurt" disappears. In lesson 6, adding a genuinely better future option lowers total value, because teams see it coming and stop sharing what they know.

And a shared route wins only through something specific: one expert serving many teams, practice that compounds, a memory of failures, a fairer way to award scarce blocks, or paying for a backup everyone needs and no one buys alone. Each lesson names one such way and shows the case where it fails.

One design rule behind every model

Every model gives a capable local team the same information, people and rules as the shared route. So the two tie by construction, and a shared route earns no premium for being called "ACM". Any win must come from something the local teams cannot or will not do alone. This is a rule we chose for building the models, not a finding.

The spine

One inequality, and every lesson opens one of its terms.

With nn teams that share a need, each paying dd to do the work alone or aa to adapt shared work, the shared route is cheaper exactly when the saving per team, times the number of teams, beats the one-off costs of sharing: the shared work itself ff, coordination qq, waiting ww and the expected loss from shared failures ll.

Checked in Lean · sharing_threshold

n (d−a)  >  f+q+w+ln\,(d-a)\;>\;f+q+w+l

In words: what each team saves, times the number of teams, must beat what sharing costs once.

Lesson 1 sets out this sum. It is accounting, and it hides almost everything interesting inside its letters. The other nine lessons each open one of them and look at the choices people make there.

Lesson map

Ten questions, in order.

  1. Lesson 1 · When does doing it once beat doing it n times?

    n(d−a)>f+q+w+ln(d-a)>f+q+w+l · Counts both routes: the saving per team times the number of teams, against the one-off costs of sharing.

  2. Lesson 2 · Better expertise, worse fit

    d−ad-a · Where the saving per team comes from: expertise widens it, mismatch narrows it.

  3. Lesson 3 · How much shared work to fund, and where expertise should sit

    ff · How large the shared investment should be, and whether depth in one person beats breadth in two.

  4. Lesson 4 · When everything is P1

    qq · Coordination becomes a game once teams compete for scarce blocks and can claim any priority.

  5. Lesson 5 · What a record of failures is worth

    ll · Failures learned once instead of once per team, and when a wrong record does harm.

  6. Lesson 6 · Making the truth worth telling

    q and lq\text{ and }l · What teams choose to report depends on what reporting earns them tomorrow.

  7. Lesson 7 · Teaching people, then stepping back

    aa · Support lowers the cost of adapting shared work, until teams can do it alone.

  8. Lesson 8 · Generalists, specialists, queues and lulls

    ww · Waiting: who is free when the work arrives, and what an idle expert costs.

  9. Lesson 9 · Train, hire or contract

    ff · The people part of the shared investment, against delivery today.

  10. Lesson 10 · Who pays for the backup nobody needs today

    ll · The loss when expertise leaves, and why nobody buys the insurance alone.

Notation

One letter, one meaning, across all ten lessons.

Every symbol on this site is defined once, here, and keeps its meaning everywhere. When a Lean file uses a different letter, the lesson says so beside the theorem.

SymbolMeaningUnitFirst used
nnNumber of teams with the same needteamsLesson 1
ddCost for one team to do the work aloneillustrative units per teamLesson 1
aaCost to adapt the shared work to one teamillustrative units per teamLesson 1
ffOne-off cost of the shared work: building it and keeping it upillustrative unitsLesson 1
qqCost of coordinating: meetings, reviews, agreeing prioritiesillustrative unitsLesson 1
wwCost of waiting for the shared routeillustrative unitsLesson 1
llExpected loss from failures on the shared routeillustrative unitsLesson 1
xxExpertise: the chance a job is done without a slipbetween 0 and 1Lesson 2
x0x_0Expertise before any shared practicebetween 0 and 1Lesson 2
bbMismatch: how far a method aims from what this job needs, after local tuningerror unitsLesson 2
σ\sigmaSize of a sliperror unitsLesson 2
EEExpected error of a route on a jobsquared error unitsLesson 2
η\etaLearning speed in the alternative, exponential learning curveper blockLesson 2
S, L{}_S,\ {}_LLabels for the shared route and the local routelabelsLesson 2
hhBlocks of shared practice fundedwhole blocksLesson 3
HHBlocks still available after committed work is protectedwhole blocksLesson 3
ggThe most shared practice could ever be worth, over the future work it can serveillustrative unitsLesson 3
ccUseful work pushed out by one block of practiceillustrative units per blockLesson 3
GGLearning gained minus work pushed out, before setupillustrative unitsLesson 3
j1, j2j_1,\ j_2Future work each of two people will actually serve, weighted by what an error there costsillustrative unitsLesson 3
VC, VSV_C,\ V_SLearning value when practice is concentrated in one person or split between twoillustrative unitsLesson 3
BBWhat the scarce slot is worth to the team that wins itteam’s illustrative unitsLesson 4
κ\kappaEffort a pitch or claim costs the team, paid win or loseteam’s illustrative unitsLesson 4
ρ\rhoShare of ideas that are strongprobabilityLesson 4
pstrong, pweakp_{\text{strong}},\ p_{\text{weak}}Chance the test passes a strong idea, a weak ideaprobabilityLesson 4
VstrongV_{\text{strong}}What a funded strong project is worth to the companyillustrative unitsLesson 4
γ\gammaWhat one test or check costs the companyillustrative unitsLesson 4
sstrong, sweaks_{\text{strong}},\ s_{\text{weak}}Chance a strong team’s claim, a weak team’s claim, survives the checkprobabilityLesson 4
φstrong, φweak\varphi_{\text{strong}},\ \varphi_{\text{weak}}Expected penalty a strong team, a weak team, faces for claimingteam’s illustrative unitsLesson 4
RfileR_{\text{file}}Net credit a team earns for filing a record instead of claimingteam’s illustrative unitsLesson 4
β\betaChance the test passes a case that no record coversprobabilityLesson 5
μstrong, μweak\mu_{\text{strong}},\ \mu_{\text{weak}}Share of strong cases, of weak cases, covered by a correct recordshare of future casesLesson 5
pˉ\bar pChance the other team both pitches and passesprobabilityLesson 5
uuUpkeep: the extra cost of keeping shared records correct and getting them to the next decisionillustrative unitsLesson 5
αuseful, αuseless\alpha_{\text{useful}},\ \alpha_{\text{useless}}Chance review accepts a useful diagnosis, a useless oneprobabilityLesson 6
pnewp_{\text{new}}Chance a team’s new project passes its own gateprobabilityLesson 6
rˉ\bar rChance the rival also holds a usable creditprobabilityLesson 6
Vnew, VoutV_{\text{new}},\ V_{\text{out}}What a passing new project is worth on average; what the ready outside work is worthillustrative unitsLesson 6
zzWhat breaking a promise costs the sponsorillustrative unitsLesson 6
Δtoday\Delta_{\text{today}}What filing rather than claiming gains the team nowteam’s illustrative unitsLesson 6
Vexpert, VstartV_{\text{expert}},\ V_{\text{start}}What the expert state, the starting state, is worth to the team next roundteam’s illustrative unitsLesson 6
πfile, πclaim\pi_{\text{file}},\ \pi_{\text{claim}}Chance the shared memory becomes expert if the team files, if it claimsprobabilityLesson 6
τ\tauChance a filed diagnosis transfers to the next decisionprobabilityLesson 6
plearnp_{\text{learn}}Chance teaching or training makes a person able to do the work alone (also lessons 9 and 10)probabilityLesson 7
pkeepp_{\text{keep}}Chance the skill is still there when the next job arrivesprobabilityLesson 7
Vteach, VstayV_{\text{teach}},\ V_{\text{stay}}Value of teaching then letting the learner work alone; of leaving the expert on the workillustrative unitsLesson 7
Valone, VadviseV_{\text{alone}},\ V_{\text{advise}}Company value of a round where the ready team works alone; where support advises itillustrative unitsLesson 7
θ\thetaWhat staying involved is worth to the support team itself, each roundillustrative units per roundLesson 7
vvValue of one job done, over the local routeillustrative unitsLesson 8
ChandoffC_{\text{handoff}}Extra cost of handing a job from one person to anotherillustrative unitsLesson 8
Cbroad, CspecC_{\text{broad}},\ C_{\text{spec}}Cost of reserving a generalist, a specialist, for the windowillustrative unitsLesson 8
pbusyp_{\text{busy}}Chance the busy spell continuesprobabilityLesson 8
CborrowC_{\text{borrow}}Fee for borrowing a specialist for one dateillustrative units per dateLesson 8
VplanV_{\text{plan}}Value of the plan named in the subscript: wait, hire, train, contract, record, teach, both, none, package (also lessons 9 and 10)illustrative unitsLesson 8
vAv_AValue of the learner’s own job today, over the local routeillustrative unitsLesson 9
pstayp_{\text{stay}}Chance the trained person stays, each dateprobabilityLesson 9
Crecord, CteachC_{\text{record}},\ C_{\text{teach}}Cost of one record, of one apprenticeship attemptillustrative unitsLesson 10
pleavep_{\text{leave}}Chance the expert leavesprobabilityLesson 10
CadminC_{\text{admin}}Running cost of a compulsory shared routeillustrative unitsLesson 10

Words

The words we use, and only in these senses.

ACM
AI capability management: whoever runs the shared route. It can be one person, a small network of people or a team.
Shared route
Doing the common part of the work once, for several teams.
Local route
Each team doing the work alone.
Product team
A team that uses AI in its own work, such as Warranty Claims or Field Repair Dispatch.
Sponsor
Whoever holds the budget for scarce specialist time, compute or vendor spend, and decides who gets it.
AI Capability Manager
The person accountable for the shared route. Other ACM jobs (Portfolio Manager, Technical Owner, Prototype Owner) appear as it grows.
Model
A small piece of mathematics we can solve exactly. Never an AI model unless we say so.
Test
A real-world trial in a company. No test has been run for this research.
Value
Benefit minus cost, in illustrative units: numbers chosen to show a shape, not measured anywhere.
Payoff
What one team gains from a choice, counted in the same units.
Best reply
The choice that gives a team its highest payoff, given what the others do.
Stable outcome (equilibrium)
A set of choices where no one can gain by changing only their own choice. Game theorists call it an equilibrium.
Strictly dominant
Better for a team whatever the others do. If a choice is strictly dominant for everyone, the stable outcome is forced.
Updating a belief
Reweighting what might be true after seeing a result: likely-under-this-story results raise that story’s weight.
Outside option
What a team or sponsor can get by walking away from the shared route.

What Lean is

A checked proof says the conclusion follows. It does not say the assumptions are true.

Lean is a program that checks every step of a proof. We write definitions, such as the cost of each route, and a claim about them. Lean accepts the claim only if every step follows from the definitions and the rules of logic. It does not accept "clearly" or "it is easy to see". If one step is missing, the file does not pass.

"Checked in Lean" therefore means one precise thing: the conclusion follows from the stated assumptions. It does not mean the assumptions describe your company. No model here has been fitted to data, and no number in a lesson is a measurement.

All the models use exact fractions, never rounded decimals, so a checked threshold is exact. The files use no unproved shortcuts and no outside mathematics library; each file asks Lean to list the axioms its main results depend on. They are checked with Lean 4.24.0, pinned to one release. Today the 14 files hold 556 theorems, counted from the source when this page is built. Many are small helper steps or concrete worked cases; they are not 556 findings about companies.

The interactive figures are drawn by separately tested JavaScript, not by Lean. The tests check that the figures reproduce the thresholds and worked cases that Lean checks. In each lesson, the theorem's exact statement sits behind a disclosure, with a link to the full source on GitHub.

How each claim is labelled

Definition
How we choose to measure something. Not true or false, only useful or not.
Assumption
A statement about the world we take as given, such as the shape of a learning curve.
Derived by hand
Follows from the definitions by algebra we did ourselves, without Lean.
Checked in Lean
Lean has checked that it follows; the theorem is named beside it.
Computed
Calculated by tested JavaScript for chosen numbers.

What is proved, what is not, what comes next

A proof closes a logical gap. Evidence closes a different one.

What Lean checks, lesson by lesson

Read every Lean file behind the lessons

  • Lesson 1 (CraftCosts.lean): The sharing threshold, the tie and the reversal for the cost sum, with two concrete cases: sharing that saves, and waiting that turns the saving into a loss.
  • Lesson 2–3 (ExpertiseScarcity.lean): Expected error splits into mismatch plus slips; the exact expertise-versus-fit threshold and a case where more expertise loses; one learning step stays between 0 and 1; the stopping rule for practice blocks finds the best whole number of blocks; the setup threshold; the exact point where concentrating practice beats splitting it.
  • Lesson 4 (ExpertiseScarcity.lean, StrategicPitch.lean): When claiming priority is free, claiming the highest priority is strictly dominant, so everyone claims it. With a costly pitch and a test, the exact range of pitch efforts in which strong ideas pitch and weak ones stay home. In a richer reporting game, the conditions under which truthful reporting is strictly dominant, alongside cases where reports pool.
  • Lesson 5 (AssessmentLearning.lean, AdaptiveExploration.lean): Records improve a later decision only when the lesson applies and is correct; wrong records and overhead can reverse the gain. An adaptive testing plan does at least as well as every feasible plan in its small model, and a plan built on the wrong assumptions about feedback can lose.
  • Lesson 6 (AccessCommitment.lean, RepeatedGame.lean): When a promise of future access makes truthful reports worth giving, and when the sponsor prefers to keep the promise. A way to check strategies over several rounds by testing one change at a time. A case where adding a genuinely better future option lowers total value.
  • Lesson 7 (PeopleDevelopment.lean, AdaptiveSupport.lean): A method that certifies the best training plan against every feasible plan; in a worked case, thresholds on how likely teaching is to work and how long the skill lasts. In two three-round support stories, neither side can gain by changing its own plan alone.
  • Lesson 8 (ACMStaffing.lean, WorkforcePlanning.lean): The best roster and schedule for given jobs, checked against every feasible schedule in a small case; hiring decisions when demand may or may not persist.
  • Lesson 9 (WorkforceDevelopment.lean): The best choice between training, hiring and contracting, checked against every feasible plan in a small model, including cases where training loses.
  • Lesson 10 (CapabilityContinuity.lean, PreservationInvestment.lean): The best plan for keeping, closing or reopening a capability, checked against every feasible plan. In the backup game, doing nothing is strictly dominant for each team, even though funding a backup together would gain; shared funding or binding cost sharing recovers it.

What is not proved

  • That the assumptions describe any real company. Learning speeds, slip sizes, test accuracy, costs and demand are all chosen, not measured.
  • That a shared route beats local teams in general. The tie between them is built in by the design rule above; each model only shows a specific way one can beat the other, and when it fails.
  • That the stable outcomes we describe are the only ones. In most games we check that a proposed outcome is stable; we rarely prove it is unique, and we do not study teams that randomize their choices.
  • Anything about real scheduling. Blocks of practice are assumed identical; real compute comes in shapes, with the right devices needed together, before a deadline.
  • That the separate models fit together. Each isolates one question; no single model of a whole company joins them yet.
  • That the JavaScript behind the figures is correct because the Lean files are. They are independent; tests tie them together.

What comes next: simulation, then real tests

A simulation could do what small models cannot: let the questions interact. The plan is to give rival arrangements exactly the same world — the same hidden opportunities, people, starting expertise, AI models, devices and surprises — and change only the rules for deciding. Then any difference in outcome comes from the rules, and we can trace which decision caused it: a lesson learned, a request never made, a queue at one expert, a missed deadline.

The core comparison crosses two choices. Do experts sit with product teams or together? Is scarce compute or budget split into local quotas or scheduled from a shared pool? That gives four arrangements. Product teams keep their own tuning and the final say on accepting results in all four. The local arrangements are allowed to share, to schedule competently and to learn; a comparison against a weakened local team proves nothing.

The simulation would first reproduce the exact cases in these lessons. Then it would vary how scarce resources are, how much future work there is, how far teams' needs differ, how well lessons transfer, how accurate tests are and what teams gain privately, and keep the cases where the shared route loses. The design and the analysis would be frozen before looking at which arrangement ranks first, and three kinds of uncertainty reported separately: the randomness of the simulation, the uncertain numbers fed into it, and the possibility that its structure is wrong.

Companies that buy AI as a service rather than train it need their own version. What is scarce there is calls, rate limits, vendor terms and the hours spent evaluating and migrating. Keeping the current model is always an option; switching to a newer one must earn its evaluation, migration and retraining costs.

The output would be a map of where a shared route helps, ties or loses, and why. It would not be a single number saying it works. After that, only real tests can say whether learning, reporting, costs and transfer behave this way in actual companies. None of this has been run yet.