Concepts / Substantial versus Imitative Engagements

Substantial versus Imitative Engagements

The document-versus-code test asks whether an engagement's primary artifact is a document or a deployment.

  • Programming

Two Proposals That Look the Same

Imagine two proposals arriving on the same desk. Both carry the same price, both name the same team, and both use confident language about delivering value for a customer's AI work. Read quickly, they seem interchangeable. Yet one may leave the customer with something real, while the other leaves a stack of slides. Before deciding which engagement deserves trust, you need a way to look past the proposal's wording and see what the work actually produces.

The diagnostic for this purpose is called the document-versus-code test. Its job is to show you what an engagement delivers, not how it describes itself. This article walks through the single question the test asks, how to apply it, and what separates the two possible answers.

The Single Question Behind the Test

Definition

The document-versus-code test asks whether an engagement's primary artifact is a document or a deployment.

Notice that the test asks one question, and it is about one thing: the primary artifact. The word primary matters. Most engagements produce several outputs along the way, such as notes, meeting summaries, and drafts. The test does not ask about those side products. It looks at the thing the engagement was fundamentally built to deliver. Find that one artifact, then classify it as either a document or a deployment. Everything else in the engagement is supporting material for that main output.

Because the test focuses on the primary artifact rather than on the sales pitch, it cuts through presentation. A proposal can describe a deployment in impressive detail while the work it actually delivers is a set of planning documents. The artifact is what the customer is left holding at the end, so it is the right thing to inspect.

The test also sets aside features that often seem important. The price, the staffing, and the wording of the proposal do not settle the question. The source specifically identifies these as features that can match across both kinds of engagement, which is why the test looks at the delivered artifact instead.

Routing an Engagement Through the Test

The test works because every engagement has a primary artifact, and that artifact falls into one of two categories. The engagement is the container, the primary artifact is what it delivers, and the artifact is either a document or a deployment. The classification then tells you whether the engagement has substance. An engagement whose primary artifact is a deployment is substantial. An engagement whose primary artifact is a document lacks substance, and it sits on the imitative side of the split that gives this article its title.

EngagementPrimary artifactthe one thing it was builtto deliverDocument ordeployment?Imitative engagementprimary artifact is adocumentSubstantialengagementprimary artifact is adeploymentidentifyclassifydocumentdeployment
Given an engagement, what single question do I ask about its primary artifact, and how does the answer route it to substantial or imitative?

Read the diagram from top to bottom. You begin with the whole engagement, narrow it to the single primary artifact, and then ask the one classifying question. The answer routes the engagement to one of two outcomes. Notice that the path never asks how large the engagement was, how senior its staff were, or how expensive it was. Those features can be identical for both outcomes.

Following One Engagement Through Time

The test becomes clearer when you trace an engagement forward through time. Take the same starting point: two firms hired to help a logistics company use AI to route its delivery requests. Watch what each firm leaves behind and what is still usable once the consulting period ends.

Worked example

Classifying the logistics engagements

Two firms were hired to help a logistics company use AI to route delivery requests. After the consulting period ends, what does each engagement leave behind, and which side of the test does each fall on?

  1. 1
    Find the primary artifact

    Ignore notes, meeting summaries, and drafts. Ask what each engagement was fundamentally built to deliver.

  2. 2
    Check whether it can run

    If the output is software running in the customer's environment, it is a deployment. If it is slides, a roadmap, or a strategy paper, it is a document.

  3. 3
    Check whether it survives

    Ask whether the customer's organization can still run the output months after the work finishes. A document is typically filed away; a deployment keeps functioning.

  4. 4
    Apply the classification

    The engagement whose primary artifact is a running system is substantial. The engagement whose primary artifact is a set of documents is imitative.

Result

The firm that leaves a working deployment has a substantial engagement. The firm that leaves only documents has an imitative one. Skill and intentions were never needed to reach this result.

What Makes a Deployment

A deployment is the primary artifact of an engagement that has substance. The source describes it through three characteristics that appear together. Each is developed below, and the final one, durability, is the practical test of substance.

Why a Document Lacks Substance

A document is the primary artifact of an engagement that lacks substance. The source gives examples: a slide deck, an architecture diagram, a roadmap, and a strategy paper. Each of these is a non-executable output. Each describes something without executing it.

Documents are not worthless in themselves. The concern is narrower. A document, by itself, does not carry substance, and it is typically filed away after some time. Once that happens, the engagement has produced nothing the customer can operate. The distinction is about what remains usable, not about whether the writing was careful or the thinking was sound.

Running productioncodeSlide decknon-executable outputMeasurable outcomesArchitecture diagramnon-executable outputShipped against aneval setRoadmapnon-executable outputStill in use afterthe engagementStrategy papernon-executable output
How do substantial and imitative engagements differ in their primary artifact and in what that artifact does?

Read the diagram column by column. The left column holds the forms a document commonly takes, all of which describe something without executing it. The right column lists the conditions that a deployment satisfies. The diagram summarizes the source's categories, so use it as a quick reference rather than a full substitute for the reasoning above.

Mistakes When Applying the Test

  • Common mistake

    Judging the engagement by its proposal wording

    What it looks like

    A proposal describes a deployment in impressive detail, so the engagement is assumed to be substantial.

    Why it fails

    The test looks at what the engagement delivers. A proposal can describe a deployment while the actual output is planning documents.

    Do this instead

    Ignore the pitch and identify the artifact the customer is left holding at the end.

  • Common mistake

    Classifying by price, team size, or seniority

    What it looks like

    An expensive engagement with a famous team is assumed to be substantial.

    Why it fails

    The source identifies price, staffing, and proposal wording as features that can match across both kinds of engagement.

    Do this instead

    Set those features aside and classify only the primary artifact.

  • Common mistake

    Treating every output as the primary artifact

    What it looks like

    Notes, meeting summaries, and drafts are counted alongside the main output.

    Why it fails

    The word primary matters. Side products are supporting material, not the thing the engagement was built to deliver.

    Do this instead

    Find the one artifact the engagement was fundamentally built to deliver, then classify only that.

  • Common mistake

    Assuming a document is worthless: the test does not say documents are poorly written, only that they do not carry substance by themselves

  • Common mistake

    Equating a deployment with simply having code

    Why it fails

    A deployment is running production code in the customer's environment, with measurable outcomes, shipped against an eval set, and still in use after the engagement.

    Do this instead

    Check all three characteristics together, and check durability as the practical test.

Classifying a New Engagement

EASY

An engagement's final handover consists of a 40-slide deck and a set of recommendations. No system was built, and nothing runs in the customer's environment. Which primary artifact does this engagement deliver, and is it substantial or imitative?

Hints
  • Ask what the engagement was fundamentally built to deliver, setting aside the recommendations as supporting material.
  • Ask whether the primary output is executable in the customer's environment.
  • A slide deck is one of the document forms the source lists.

Key Takeaways

  1. 1
    The document-versus-code test asks one question: is the engagement's primary artifact a document or a deployment?
  2. 2
    Only the primary artifact is classified; notes, summaries, and drafts are supporting material.
  3. 3
    A deployment runs production code in the customer's environment, has measurable outcomes, is shipped against an eval set, and survives the engagement.
  4. 4
    A document such as a slide deck, roadmap, or strategy paper does not have substance by itself and is typically filed away.
  5. 5
    Price, staffing, and proposal wording do not settle the question.

At a glance

  • The document-versus-code test asks whether an engagement's primary artifact is a document or a deployment.
  • Identify the one artifact the engagement was built to deliver, and set aside supporting outputs and the sales pitch.
  • A deployment runs in the customer's environment, has measurable outcomes, is shipped against an eval set, and keeps working after the engagement ends.
  • A document lacks substance by itself and is typically filed away, so the engagement producing only documents is imitative.