Concepts / Building Foundation Model Applications

Building Foundation Model Applications

The ease of building is the starting point, and it does not stop at you.

  • Programming

The Question Every AI Product Must Answer

Suppose you have built an AI application and decided to sell it as a standalone product. The first business question is not how well it works today. It is whether the product can be defended. Defensibility is the ability of an AI application to keep a competitive edge over time. Put simply, once you have built something, what stops someone else from doing the same thing?

The source frames the answer around moats, meaning the things that protect a product from competitors. This article follows that framing. It works through why defensibility is hard in AI, what kinds of advantage AI companies can build, and how those advantages play out for startups competing with much larger companies. Keep one central question in mind as you read: what would protect this product if a well-resourced competitor decided to copy it?

What do you think happens?

If a competitor can assemble a copy of your AI product quickly, what do you think protects your product?

Reveal answer
Answer:

Only a moat protects it: a durable advantage such as technology, data, or distribution that the competitor cannot easily reproduce.

The source says a product that anyone can assemble offers little protection on its own, so the protection has to come from something beyond the build itself.

How a Low Entry Barrier Leads to Copying

The source describes the low entry barrier as both a blessing and a curse. The same ease that lets you build an AI product quickly also lets your competitors build it quickly. If something is easy for you to build, it is also easy for them to build. A product that anyone can assemble offers little protection on its own.

Building becomescheap and easyMany teams canassemble the productCompetitors build thesame productProduct offers littleprotectionDifferentiationerodeslowers the barrier for everyonecopying becomes easysame product, same valueadvantage fades
What sequence of events follows when building an AI application becomes cheap and easy, and how does that lead to copying and eroded differentiation?

Read the flowchart from top to bottom. The ease of building is the starting point, and it does not stop at you. The same step that makes your launch fast makes a rival launch fast. The end of the chain is not a failed product. It is a product whose differentiation has eroded, because nothing about the assembled product itself stops a copy.

Thin Layers on Top of Foundation Models

Many AI applications are built as a layer on top of foundation models. The source points out a second risk in that arrangement. If the underlying models expand in capability, the layer you provide might be subsumed by the models, which would make your application obsolete. In other words, your product's value depends partly on a gap that the underlying model may later close.

Standalone layerLimited modelLayer subsumedExpanded modelsits onabsorbs
What changes when the underlying model gains capability that the application's layer used to provide?

The Three Types of Competitive Advantage

The source says that in AI there are generally three types of competitive advantage: technology, data, and distribution. These are different sources of protection, and they do not all belong to the same kind of company. Think of them as three separate moats rather than three names for the same thing.

Competitiveadvantage in AITechnologyDataDistributionability to bring product infront of userstype oftype oftype of
How do the three types of advantage relate to one another, and which one sits under the others as the category they belong to?

Competitive advantage in AI is the umbrella category, and technology, data, and distribution are the three branches. The source defines only distribution precisely, as the ability to bring your product in front of users. Data and distribution are developed in the sections that follow, because the source treats them in the most detail when comparing startups with large companies.

Data as a Moat for a First-Mover Startup

The source gives a more careful view of data than of the other advantages. Big companies likely have more existing data. However, if a startup can get to market first and gather sufficient usage data to keep improving its product, data becomes its moat. The key idea is that the advantage is not the data a company happens to hold at the start. It is the data the company accumulates by being used.

The source also makes a point about data that cannot be used for training. Even when user data cannot be used to train models directly, usage information can give valuable insight into user behavior and product shortcomings. That insight can then guide what data is collected and how training is done. The flow is indirect, but it is still valuable.

Worked example

Tracing a startup's data moat over time

A small team launches a note-summarizing app built as a layer on a foundation model. A large company could build a similar feature. How does the startup's data position change as people use the app?

  1. 1
    Step 1: Launch first

    The startup reaches the market before larger rivals, so early users start generating usage data.

  2. 2
    Step 2: Accumulate usage

    Each session adds information about what users ask for and where the product falls short.

  3. 3
    Step 3: Learn from insight

    Even where user data cannot train the model directly, the usage insight shows which data to collect and how training should be done.

  4. 4
    Step 4: Improve the product

    The product keeps improving, and the accumulated usage becomes the moat rather than any data the team held at the start.

Result

The startup's advantage comes from the data it gathers by being used. A competitor that enters later starts with less of that accumulated usage, even if it begins with more existing data.

Startup and Large Company on Data and Distribution

The source ties distribution to big companies. It says distribution likely belongs to big companies, and it defines distribution as the ability to bring your product in front of users. Data cuts the other way for a startup that moves first. Judging the two advantages means asking which side of each comparison a given company is on.

Usage data gatheredby first moverMore existing dataUsage insight guidescollectionDistribution to users
Where does a startup have an edge over a large company on data and distribution, and where does the large company have the edge?

Read the comparison column by column. The startup's edge in data comes from gathering usage after it reaches the market first. The large company's edge in data comes from the existing holdings it likely already has. On distribution, the source places the advantage with big companies. A startup can still win on data, but it should not assume it can match a large company's reach to users.

  • Common mistake

    Assuming that owning a lot of data at the start is the moat

    What it looks like

    A team argues its dataset it holds today will keep competitors away.

    Why it fails

    The source says the advantage is not the data a company holds at the start, but the data it accumulates by being used.

    Do this instead

    Ask how the product will gather usage data over time, not only what data exists today.

  • Common mistake

    Treating a thin layer on a foundation model as safe from model improvements

    What it looks like

    A product that only adds a prompt wrapper assumes the model will never gain that capability.

    Why it fails

    The source warns that the layer may be subsumed if the underlying models expand in capability.

    Do this instead

    Check which part of the product's value depends on a gap the model may later close.

  • Common mistake

    Reading the three advantages as one thing

    Why it fails

    The source presents technology, data, and distribution as different sources of protection that do not all belong to the same kind of company.

  • Common mistake

    Assuming a startup can match a large company's distribution

    Why it fails

    The source says distribution likely belongs to big companies.

Judging a Startup's Defensibility

MEDIUM

A startup has built a thin AI layer on a foundation model. It reached the market first and is gathering usage data that improves its product. A large company with strong distribution is considering entering the same space. Which advantages are most likely to protect the startup, and which one is most likely to favor the large company? Justify your answer using the three types of advantage.

Hints
  • Start by listing the three types of advantage: technology, data, and distribution.
  • Ask whether the startup's data is the data it held at the start or the data it accumulates by being used.
  • Check the source's statement about which company distribution likely belongs to, and the risk of a thin layer being subsumed.

Features That Grew Into Products

The source notes that many successful companies began as products that could have been features of larger products. The pattern is that a startup builds a feature that bigger competitors overlooked, and that feature grows into a product that can eventually overtake them. The source names three examples, each paired with a larger product it could have been part of, but the examples themselves are not described in the material available here, so this article relies on the pattern rather than on those cases.

Key Takeaways

  • A low entry barrier makes AI applications easy to build, and that same ease lets competitors copy them quickly, so a product anyone can assemble offers little protection on its own.
  • A layer built on foundation models can be subsumed if the underlying models expand in capability, so its value depends on a gap the model may later close.
  • The three types of competitive advantage in AI are technology, data, and distribution, and they are different sources of protection.
  • Data can become a moat for a startup that reaches market first and accumulates usage data, while distribution likely belongs to big companies.

Related concepts

More concepts starting with B