Concepts / Why Data Synthesis is Useful

Why Data Synthesis is Useful

Privacy concerns arise when data contains sensitive information, such as real patient records and real insurance claims.

  • Programming

Why Patient Files Are Hard to Use

Imagine you are asked to build an AI model that predicts health outcomes for patients. The most obvious source of training material is the records that already exist: real patient files, collected over years of care. Yet in many organizations those records cannot simply be handed to a model-building team. The data is valuable precisely because it describes real people, and that is the reason it is difficult to use.

This article follows that problem step by step. You will trace what happens to real records when they are considered for training, see the approach the course describes for mitigating the problem, which is synthetic data, and then check your understanding by deciding which kind of data to use in a scenario.

Tracing Real Records Toward a Model

Start with a real patient file as the state of the data at the beginning. It holds information about a real person, gathered during care. When a model-building team wants to use that file as training material, the first question is whether the data may be used at all. The file contains sensitive information, and privacy concerns arise whenever data contains sensitive information such as real patient records and real insurance claims.

So the record in its current state is valuable as a description of real people but blocked as training material. The useful question becomes: can the same kind of information be obtained in a form that does not carry the sensitive content? That question leads to synthetic data.

What Synthetic Data Means

Definition

Synthetic data is data generated to mimic real data without containing sensitive information.

The definition has two halves that work together. The first half says synthetic data is generated: it is produced rather than collected from people. The second half says it mimics real data, so it resembles the original material closely enough to be useful. The final clause is the reason it exists: the generated data does not contain the sensitive information that makes the real records restricted.

Synthetic data is often the only option where human-generated data cannot be used due to privacy concerns. Synthetic patient records and synthetic claims are the two examples the course uses to make this concrete.

Following the Data from Real to Synthetic

The movement of data can be read as a sequence of states. The real patient records begin in a restricted state. A synthetic dataset is then generated to mimic them. The synthetic dataset is in a different state: it is free of the sensitive information. Only that second state can be used to train the model without exposing the sensitive content.

Real patientrecordsContain sensitiveinformationSynthetic generationData generated to mimicreal dataSynthetic datasetNo sensitive informationAI model trainingModel trained on syntheticdatamimicked byproducesused for
What steps move data from real patient or claims records to a synthetic dataset that can train a model without exposing sensitive information?

Read the diagram from left to right. The data changes state at the generation step, and the change is what matters: the dataset that reaches the model is the one that no longer carries the sensitive content. The real records remain restricted, and the model is never trained on them directly in this path.

Industries Where Privacy Weighs Heavily

Healthcare is the clearest case in the course material. Patient records describe real people over years of care, and legislation in healthcare restricts their use for training models. Insurance is the second industry the course names: insurance claims are real records that contain sensitive information, so they raise the same privacy concern.

In both industries the data is valuable for exactly the reason it is hard to share. A claim or a patient file is useful because it records what happened to a real person, and that same fact is what makes it sensitive.

Comparing Real and Synthetic Records

The clearest way to see the difference is to set each real record beside its synthetic counterpart. The two columns below pair real patient records with synthetic patient records, and real insurance claims with synthetic claims.

Real patient recordsContain sensitiveinformationSynthetic patientrecordsNo sensitive informationReal insurance claimsContain sensitiveinformationSynthetic claimsNo sensitive informationgenerated to mimicgenerated to mimic
How do synthetic patient records and synthetic claims differ from their real counterparts in content and in sensitive information?

Each synthetic record is paired with the real record it mimics, so it keeps the same general shape as the original. The difference lies in the sensitive information: the real records contain it, and the synthetic records are described as not containing any. This is why the synthetic versions can be used where the originals cannot.

Real and Synthetic Side by Side

AspectReal records and claimsSynthetic records and claims
OriginCollected from real people during care or insurance activityGenerated to mimic real data
Sensitive informationContains sensitive informationDoes not contain sensitive information
Use for trainingOften restricted, especially in healthcareCan be used where human-generated data cannot
RelationshipThe source material being mimickedResembles the source without its sensitive content

Real and synthetic patient records and claims compared

Worked Scenario: Choosing a Training Source

Worked example

Choosing data for a health outcomes model

A team must train an AI model that predicts health outcomes for patients. The existing real patient files describe real people and are subject to healthcare legislation. Which source can the team use, and why?

  1. 1
    Identify the data state

    The real patient files contain sensitive information about real people.

  2. 2
    Check the restriction

    Legislation in healthcare makes it hard, if not impossible, to use real patient records to train a model, so the real files are not a safe default.

  3. 3
    Consider the alternative

    Synthetic data is data generated to mimic real data without containing sensitive information, and it is often the only option where human-generated data cannot be used.

  4. 4
    Choose the source

    A synthetic patient dataset that mimics the real files can be used for training, because it does not carry the sensitive content.

Result

The team should train on a synthetic patient dataset rather than the real patient files, since the synthetic data mimics the real records without containing their sensitive information.

Mistakes When Reasoning About Synthetic Data

  • Common mistake

    Assuming any real data can be used for training if the team has access to it

    What it looks like

    A team already holds years of patient files and decides to train directly on them.

    Why it fails

    Privacy concerns arise when data contains sensitive information, and legislation in healthcare makes it hard, if not impossible, to use real patient records to train a model. Access alone does not make the data usable.

    Do this instead

    Check whether the data contains sensitive information and whether it is restricted before using it. Consider synthetic data when human-generated data cannot be used.

  • Common mistake

    Thinking synthetic data is simply a copy of the real records with the names removed

    What it looks like

    Removing identifying fields from a real claim and calling the result synthetic.

    Why it fails

    Synthetic data is defined as data generated to mimic real data. It is produced rather than extracted from the original records, and the definition is about generation, not editing.

    Do this instead

    Describe a dataset as synthetic only when it is generated to mimic real data and does not contain sensitive information.

  • Common mistake

    Believing privacy concerns only matter in healthcare

    Why it fails

    The course names insurance as a second industry where privacy concerns are significant, because insurance claims contain sensitive information.

Practice: Deciding Which Data to Use

MEDIUM

A health insurer wants to train a model on claims. Its real claims contain sensitive information about real people. Decide which dataset is appropriate for training, and explain your reasoning by naming the property of the data that drives your choice.

Hints
  • Ask whether the real claims contain sensitive information.
  • Recall what synthetic data is defined to mimic and what it does not contain.
  • Insurance is named in the course as an industry where privacy concerns are significant.

What do you think happens?

Before reading on, predict: can the real patient files be used directly to train the model?

  • Yes, they are the most obvious source

  • No, or at least it is hard to do so because of legislation

Reveal answer
Answer:

No, or at least it is hard to do so because of legislation

Legislation in healthcare makes it hard, if not impossible, to use real patient records to train a model, so the synthetic alternative is used instead.

Key Takeaways

  • Real human-generated data, such as patient records and insurance claims, often contains sensitive information and cannot always be used to train AI models.
  • Synthetic data is data generated to mimic real data without containing sensitive information.
  • Synthetic data is often the only option where human-generated data cannot be used due to privacy concerns, including synthetic patient records and synthetic claims.
  • Healthcare and insurance are industries where privacy concerns are significant, and healthcare legislation makes it hard, if not impossible, to use real patient records for training.

Related concepts

More concepts starting with W