Concepts / Licensing and Usage Rights for Models

Licensing and Usage Rights for Models

Lineage is a question about the training data, not about the model's accuracy. A model can be accurate and still have a lineage that restricts how you may use it.

  • Programming

Why Performance Is Not the Whole Question

What do you think happens?

A model scores well on every benchmark you run. Does that tell you whether you are permitted to use it?

  • Yes, a strong score means the model is safe to use

  • No, a strong score says nothing about where the knowledge came from or what rules govern that origin

Reveal answer
Answer:

No, a strong score says nothing about where the knowledge came from or what rules govern that origin.

When people evaluate a model, they usually ask whether it performs well. A second question matters just as much: where did the model's knowledge come from, and what rules govern that origin? That second question is answered by data lineage.

This article follows one line of reasoning. We start with the origin of the training data, follow that data through the licenses and terms attached to it, and then look at how evaluation has to account for what the model has absorbed. By the end, you should be able to look at a model and ask the questions that its lineage makes necessary.

Models are likely trained on data scraped from the internet. Because of this, lineage is not an abstract concern. It determines what the model may have learned from, and whose rules apply to that material.

What Data Lineage Records

Definition

Data lineage is the origin and history of the data used to train a model. It is the record of where that data originated and how it has passed through the hands of different parties before reaching the model. It has to be known before a model's use can be judged.

The definition has two parts that you should keep separate. The origin is the first place the material came from, such as content published on the open web. The history is everything that happened to it afterward, including every party that handled, collected, or passed it along. Lineage asks about both. Knowing only that a model was trained on web content tells you about the origin, but not about the chain of parties that may have added their own conditions.

Key point

Lineage is a question about the training data, not about the model's accuracy. A model can be accurate and still have a lineage that restricts how you may use it.

Tracing a Dataset from Source to Model

The diagram below shows the path that training data can take. A model does not stand alone. Its training data can come from the open web, and it can also come from the outputs of another model. Each of those sources carries its own conditions. Reading the diagram from left to right is the lineage question: where did each input come from, and who set the rules for it?

Open web contentcontent created by thepublicCollected fortrainingscraped or gatheredPassed betweenpartieseach party may addconditionsTraining datasetcombined training materialTrained modelcarries inherited lineageOutputs of anothermodelproduced by a differentmodelgatheredhanded onused as inputincludedtrains
What happens to a dataset between its origin and the trained model, and at which steps does its license or history get recorded or lost?

The diagram is a simplified view. Its purpose is to show that the record of where the data came from can pass through several hands before it reaches the model. Lineage is the discipline of reconstructing that path, so that you can see at each step which party set which rules.

In the real world

The source gives a public-interest argument that makes lineage a subject of debate. Because the public generated the content that models are trained on, some people argue that the public should have the right to access the training data. Whether or not you agree with that position, it shows why lineage matters beyond the technical details of building a model.

Two Layers of Rules on One Model

A model can be governed by more than one set of rules at once. The first layer is the model's own license, which states what its owner allows. The second layer is the upstream material the model was built from. That material may have an owner who set separate restrictions. A license that permits something does not automatically override a restriction placed upstream in the chain.

The source states this directly: a model's own license does not override restrictions on its upstream training sources, such as the terms of a model whose outputs were used for training. This is why a permission on one layer is not enough on its own.

Trained modelthe model being assessedModel's own licensewhat the owner allowsOpen web contenttermsrules set by content ownersPermitted useslimited by every layeraboveUpstream trainingsourcesmaterial the model wasbuilt fromOther model's termsrules on that model'soutputsgranted by ownerbuilt fromrestricted byrestricted bypermitsconstrainsconstrains
How do the terms attached to each training data source flow up and restrict the model's final license and permitted uses?

Read the tree from the top down. The model's own license grants some permissions, but the upstream branches add constraints that reach down into the final list of permitted uses. Those constraints do not disappear because the top layer is permissive. The result is limited by every layer that feeds into it.

In the real world

The source offers an analogy from software. The Elastic License forbids companies from offering the open source version of Elastic as a hosted service, and from competing with the Elasticsearch platform. The restriction concerns how the software can be used commercially. A model's training data can carry similar restrictions, so a model's own permissions cannot be read in isolation.

Worked example

Judging a model built on another model's outputs

A team is offered a model whose own license permits commercial use. The team learns that part of its training data consisted of outputs from another model, and that model's terms restrict certain uses. Can the team assume commercial use is permitted?

  1. 1
    Identify the model's own license

    The license grants commercial use. This is one layer of rules, and it is a real permission.

  2. 2
    List every upstream training source

    The team now knows that outputs from another model are part of the training data. That is a second layer.

  3. 3
    Read the terms of each upstream source

    The other model's terms restrict certain uses. Those terms were set by a different party.

  4. 4
    Check whether the top layer overrides the restriction

    The source states that a model's own license does not override restrictions on its upstream training sources. The commercial permission does not cancel the restriction.

  5. 5
    Conclude for the specific use

    Commercial use is permitted only where it does not conflict with the upstream terms. The team must check that specific use against those terms before relying on the license.

Result

The permission on the model's own license is necessary but not sufficient. The team must trace the restrictions back to the upstream sources before deciding the use is allowed. This example is generated for teaching and is not legal advice.

Stepping Through a Lineage Review

A lineage review asks a fixed set of questions about each model before evaluation results are trusted. Work through the questions in order for any model you are asked to assess. The questions below follow directly from the source's examples. They do not replace legal advice.

  1. 1
    Where did the training data originate? Identify the first source, such as content published on the open web or outputs of another model.
  2. 2
    How did the data pass between parties? Record each party that collected, handled, or passed on the material, because each may have set conditions.
  3. 3
    What does the model's own license allow? Note the permissions the owner has granted.
  4. 4
    What restrictions were placed upstream? Read the terms attached to each training source, and do not stop at the model's own license.
  5. 5
    Does any upstream restriction limit the specific use you have in mind? If so, the permission on the top layer does not settle the question.
  6. 6
    Only after the lineage is clear, decide whether evaluation results are relevant to the use you are judging.
MEDIUM

A model's own license allows free redistribution. Its training data includes outputs produced by another model whose terms prohibit using those outputs to build competing products. Trace the lineage review steps and state whether redistribution is settled by the top-layer license alone.

Hints
  • Step 3 gives the top-layer permission. Step 4 asks what upstream restrictions exist.
  • Compare the upstream terms with the specific use you are judging, not with the model in general.
  • Remember that a license that permits something does not automatically override an upstream restriction.

Checking What the Model Should Not Know

Lineage explains what a model may have absorbed. Model evaluation then asks whether the model behaves correctly with that knowledge. One of the harder parts is knowledge boundaries. A model playing a role should respond the way that character would, and that includes not knowing things the character would not know.

The source describes a roleplaying example built around Jackie Chan. If Jackie Chan does not speak Vietnamese, then the roleplaying model should not speak Vietnamese either. Evaluating that model means deliberately testing for this boundary. You ask about the thing the character should not know and check whether the model reveals it.

What do you think happens?

In the roleplaying example, the character does not speak Vietnamese. What should the model do when a user asks it to reply in Vietnamese?

  • Reply in Vietnamese, because the model knows the language

  • Keep to the character's limits and not reveal the Vietnamese ability

Reveal answer
Answer:

Keep to the character's limits and not reveal the Vietnamese ability.

The roleplaying model should not speak Vietnamese if the character does not. Testing for this boundary is the negative knowledge check.

Facts the characterknowsmay be revealedVietnamese languagenot known by the characterin this exampleFacts the characterdoes not knowshould not be revealedModel's actualreplieschecked during evaluationmust not appearmay appear
How does the model's actual knowledge compare with the allowed and disallowed knowledge sets, and where do they overlap or diverge?

The comparison shows the two sets a negative knowledge check examines. Replies should stay within the allowed set, and any reply that falls into the disallowed set is a failure, even if the reply is accurate. The check overlaps with ordinary evaluation, but it asks a different question: not whether the model is correct, but whether it keeps within the limits its role requires.

Mistakes in Judging Permission

  • Common mistake

    Assuming an open-weight model is free of usage restrictions

    What it looks like

    A team sees that a model's weights are openly available and concludes that every use is permitted.

    Why it fails

    Availability of the model does not reveal the terms attached to its training sources. The model's own license is one layer, and upstream restrictions can still apply.

    Do this instead

    Trace the license terms back through the data sources before concluding that a use is allowed.

  • Common mistake

    Treating a permissive license as the end of the question

    What it looks like

    A model's license allows commercial use, so the team stops checking.

    Why it fails

    A license that permits something does not automatically override a restriction placed upstream in the chain.

    Do this instead

    Read the terms of each upstream source and check whether any of them limit the specific use.

  • Common mistake

    Judging safety only by how well the model performs

    What it looks like

    A model scores highly on accuracy tests, so it is assumed to be safe to deploy in a role.

    Why it fails

    Performance does not show where the knowledge came from, and it does not show whether the model keeps to its knowledge boundaries.

    Do this instead

    Run a negative knowledge check and a lineage review in addition to performance tests.

  • Common mistake

    Skipping evaluation because the lineage looks clean

QuestionFaulty inferenceCorrect check
Can I use this model?The weights are openly available, so yes.Trace the license and every upstream training source, then check the specific use.
Does a permissive license settle it?Yes, the top layer allows it.No. A license does not automatically override an upstream restriction.
Is the model ready for a role?It scores well, so yes.Run a negative knowledge check to confirm it does not reveal what the role should not know.

Faulty reasoning compared with the correct check when judging permission

Keeping Lineage and Evaluation Together

Best practice

Treat lineage and evaluation as two parts of one review. Lineage tells you what the model may have absorbed and which rules govern that material. Evaluation tells you whether the model behaves correctly with that knowledge, including whether it keeps within the boundaries its role requires. Neither answers the question alone.

Key Takeaways

  • Data lineage is the origin and history of the data used to train a model, and it must be known before the model's use can be judged.
  • A model's own license does not override restrictions on its upstream training sources, so permissions must be traced through every layer.
  • Negative knowledge checks test whether a model reveals things it should not know, which matters especially for roles such as game characters.
  • Faulty reasoning, such as assuming an open-weight model is free of restrictions, is avoided by tracing license terms back to the data sources and running both lineage and evaluation checks.

Related concepts

More concepts starting with L