Deployment as the Primary Artifact
The document-versus-code test asks whether an engagement's primary artifact is a document or a deployment.
Two Proposals on the Same Desk
Imagine two proposals arriving on the same desk. Both carry the same price, both name the same team, and both use confident language about delivering value for a customer's AI work. Read quickly, they seem interchangeable. Yet one may leave the customer with something real, while the other leaves a stack of slides. Before deciding which engagement deserves trust, you need a way to look past the proposal's wording and see what the work actually produces. The diagnostic used for exactly that purpose is called the document-versus-code test.
What do you think happens?
If two proposals share the same price, the same team, and the same confident wording, can those features tell you which engagement is substantial?
Reveal answer
No. Price, staffing, and proposal wording do not settle the question. The test looks at what the engagement actually delivers.
Because the same price, team size, and tone can appear in both a real engagement and an empty one, the test sets those features aside and inspects the artifact the customer is left holding.
The Single Question the Test Asks
The document-versus-code test asks whether an engagement's primary artifact is a document or a deployment. The answer tells you whether the engagement has substance.
The word primary does most of the work in that question. Most engagements produce several outputs along the way, such as notes, meeting summaries, and drafts. The test does not ask about those side products. It looks at the thing the engagement was fundamentally built to deliver. Find that one artifact, then classify it as either a document or a deployment. Everything else in the engagement is supporting material for that main output.
Because the test focuses on the primary artifact rather than on the sales pitch, it cuts through presentation. A proposal can describe a deployment in impressive detail while the work it actually delivers is a set of planning documents. The artifact is what the customer is left holding at the end, so it is the right thing to inspect.
The test works because every engagement has a primary artifact, and that artifact falls into one of two categories. The engagement is the container, the primary artifact is what it delivers, and the artifact is either a document or a deployment. The test does not ask how large the engagement was, how senior its staff were, or how expensive it was. Those features can be identical for both outcomes, which is exactly why the test looks elsewhere.
Read the flowchart from top to bottom. You first locate the engagement's primary artifact and ignore the side outputs. You then ask the one question: is this artifact a document or a deployment? A deployment leads to the substantial label. A document leads to the imitative label, and the test then looks at how the document has been used rather than how well it was written.
Two Kinds of Primary Artifact
Once you have identified the primary artifact, the classification depends on which of the two categories it belongs to. The source describes each category through its characteristics, so the sections below take each in turn.
Tracing a Logistics Engagement Forward
The test becomes clearer when you trace an engagement forward through time. The source describes two firms hired to help a logistics company use AI to route its delivery requests, and asks you to watch what each firm leaves behind once the consulting period ends. The source does not spell out what either firm delivered, so the walkthrough below uses a hypothetical version to show how the test is applied.
Applying the Test to Two Routing Engagements
Two firms were hired to help a logistics company use AI to route delivery requests. Firm A and Firm B had the same price, team size, and proposal tone. Which engagement has a deployment as its primary artifact?
- 1Identify the primary artifact of Firm A
Firm A's main output is a routing service running on the company's own systems, which is the thing the engagement was built to deliver. Its meeting notes and drafts are side products and are set aside.
- 2Check Firm A against the three characteristics
The service runs as production code in the customer's environment. Its routing results are measured against outcomes. It was shipped against an eval set of tests that judge its behavior.
- 3Apply the survival check to Firm A
Six months after the consultants leave, the logistics team still runs the service and still routes requests with it. The artifact survives the engagement, so it is a deployment.
- 4Identify the primary artifact of Firm B
Firm B's main output is a stack of planning material: a roadmap, an architecture diagram, and a strategy paper. None of these processes a customer's requests when switched on.
- 5Apply the survival check to Firm B
After the consulting period, the planning material is filed away. The customer cannot operate anything from it, so the primary artifact is a document and the engagement is imitative.
Firm A's engagement is substantial because its primary artifact is a deployment. Firm B's engagement is imitative because its primary artifact is a document, even though both proposals looked the same on the desk.
Notice that the example never needed to judge either firm's skill or intentions. The test asked only what was delivered and whether it could still be run. The price, the team size, and the proposal's tone were set aside, since those features can match across both kinds of engagement.
Deployment Versus Document Side by Side
Putting the two outputs next to each other makes the contrast easier to see. The comparison below lists the features the test is really looking at: whether the output can run, whether its results can be measured, and whether it remains in use after the engagement ends. Read the diagram row by row. The left column holds the forms a document commonly takes, all of which describe something without executing it. The right column lists the conditions that a deployment satisfies.
The diagram is a summary of the source's categories, so use it as a quick reference rather than a full substitute for the reasoning above. The key contrast is the last row. A document can be well written and still leave the customer with nothing operable, while a deployment keeps working after the people who built it have gone.
Mistakes When Applying the Test
Common mistake Classifying the engagement by its side outputs
What it looks likeJudging an engagement by its meeting notes and drafts, which are real work products.
Why it failsThe test looks only at the primary artifact, the thing the engagement was fundamentally built to deliver. Side products are supporting material.
Do this insteadFind the one artifact the engagement was built to deliver, then classify only that.
Common mistake Trusting the proposal's description of the work
What it looks likeAccepting a proposal that describes a deployment in impressive detail as proof that a deployment was delivered.
Why it failsA proposal can describe a deployment while the work it delivers is planning documents. The test cuts through presentation.
Do this insteadInspect what the customer is left holding at the end of the engagement.
Common mistake Using price, team size, or seniority as evidence of substance
What it looks likeAssuming a larger, more expensive engagement must have produced a deployment.
Why it failsThe source identifies these features as ones that can be identical for both kinds of engagement, so they do not settle the question.
Common mistake Treating a document as worthless
What it looks likeConcluding that a roadmap or architecture diagram has no value at all.
Why it failsThe concern is narrower. A document does not carry substance by itself, and the test is about what remains usable.
Do this insteadClassify the document as a non-executable primary artifact and note that it is typically filed away.
Common mistake Checking only whether the software was built, without checking whether it was shipped against an eval set or measured
Classify Two Engagements
An engagement's main output is a customer-facing scoring service that runs in the customer's environment, has defined success measures, and was shipped against an eval set. Six months later the customer still uses it. Is the primary artifact a document or a deployment, and is the engagement substantial or imitative? Name the characteristic that decides it.
Hints
- Identify the primary artifact first and ignore any side outputs.
- Check whether the artifact runs, whether its outcomes can be measured, and whether it survives the engagement.
- The durability check is the most practical one in the source.
Key Takeaways
- The document-versus-code test asks one question: is the engagement's primary artifact a document or a deployment?
- Price, staffing, team size, and proposal wording do not settle the question, because the test looks at what the engagement actually delivers.
- A deployment runs production code in the customer's environment, has measurable outcomes, has been shipped against an eval set, and keeps working after the engagement ends.
- A document such as a slide deck, architecture diagram, roadmap, or strategy paper is non-executable and typically filed away, so the engagement lacks substance.