Concepts / Generative AI for Images and Video

Generative AI for Images and Video

The source attributes AI's strength in creative tasks to its probabilistic nature, and names tools for image generation, photo editing, and video generation.

  • Programming

A Banned Practice Turned Everyday Feature

Generative AI for images and video is one of the most visible areas where AI is being used today. Tools can produce pictures, edit photographs, and generate short video clips. To see why this area has grown so quickly, it helps to start with a small case that shows how fast attitudes can change. The case involves AI-generated profile pictures.

What do you think happens?

In 2019, how did many social media platforms treat AI-generated profile pictures?

  • As a built-in feature that users were encouraged to try

  • As a banned practice that platforms treated as a problem

  • As a tool available only to enterprises

Reveal answer
Answer:

As a banned practice that platforms treated as a problem

By 2023 the same kind of image had become a built-in feature in many social media apps. Following that change over time is a useful way to understand the topic.

Why Creative Work Suits a Probabilistic Generator

Creative work is one of the areas where AI has found some of its most visible success. The reason given is AI's probabilistic nature. A fixed-rule tool produces the same kind of result for the same kind of input by following a set procedure. A probabilistic generator does not follow one fixed rule for every output. Its results can differ from one attempt to the next.

This openness matters for creative tasks because many tasks have several acceptable answers rather than one correct answer. A headline, a color palette, or a scene can each have many good versions. A generator whose outputs vary is well matched to a problem where variety is useful, which is why creative tools are a natural fit for it.

Fixed rule for eachoutputSuits one correctanswerResults differbetween attemptsSuits many acceptableanswers
How a probabilistic generator differs from a deterministic tool when producing creative outputs such as images

Reading the comparison as a column pair makes the contrast clear. The left column describes a tool whose output is set by a fixed rule. The right column describes a generator whose output varies, and whose variety is the property that suits creative work.

Image, Photo Editing, and Video Tools

The material points to several startups as evidence of how this area is developing. The tools fall into three groups by what they do. Each group is listed below with its named tools.

  • Image generation: Midjourney
  • Photo editing: Adobe Firefly
  • Video generation: Runway, Pika Labs, and Sora

The material also reports market signals. Midjourney, at one and a half years old in late 2023, had already generated 200 million dollars in annual recurring revenue. As of December 2023, half of the top 10 free Graphics and Design apps on the Apple App Store had AI in their names.

From Banned to Built-In Profile Pictures

The main lesson of the profile picture case is the change in public attitude, not any single image. In 2019, a platform treated AI-generated profile pictures as a problem and banned the practice. By 2023, platforms had started offering the same kind of image as a feature, and it had become a built-in feature in many social media apps. The image did not change. The attitude did.

2019Banned practice2023Built-in feature in manyappsattitude shifted
How public attitudes toward AI-generated profile pictures changed across the years from 2019 to 2023

AI-generated profile pictures are now common on social media, from LinkedIn to TikTok. One motivation the material explains is that many job candidates believe AI-generated headshots can help them present themselves well and improve their chances of landing a job. Read this motivation alongside the timeline above: the same kind of image moved from restricted to widely accepted.

Enterprise Ad Workflow From Draft to Choice

Advertising and marketing have been quick to adopt AI. The material describes three things AI can do for an enterprise. It can generate promotional images and videos directly. It can help brainstorm ideas. It can also produce first drafts that human experts then refine. The key idea is that AI typically takes a starting role, and people shape the result.

The workflow has a fixed order, and each stage depends on the one before it. AI can create multiple ads and seasonal or location variations. Audience testing then decides which version works best. The chosen version is picked from the test results, not from the first draft. The flowchart below follows one ad from first draft to chosen version.

AI first draftPromotional image or videoHuman experts refineIterate on the draftCreate variantsMultiple ads, seasonal andlocation versionsAudience testingTest each versionChosen versionSelected from test resultsfeedsfeedsfeedsresults decide
The order of the draft, vary, and test steps, with the chosen version coming from the test results
Worked example

Tracing one seasonal ad through the workflow

A company wants a promotional image for a seasonal campaign. Trace what the ad looks like at each stage, and say which stage makes the final choice.

  1. 1
    Stage 1: AI first draft

    AI generates a first draft promotional image. The draft is a starting point, not the final ad.

  2. 2
    Stage 2: Human refinement

    Human experts review the draft and iterate on it until it fits the campaign.

  3. 3
    Stage 3: Variants

    The refined ad is varied into several versions, such as a seasonal version and location versions for different regions.

  4. 4
    Stage 4: Audience testing

    Each version is tested with an audience. The results show how each version performs.

  5. 5
    Stage 5: Choice

    The version that works best is chosen from the test results, not from the first draft.

Result

The first draft started the process, but the test results chose the final version. Human experts shaped the draft at stage 2.

Where Human Experts Stay in the Loop

In the workflow, human experts keep a central role at several points. They refine the AI first draft and iterate on it. The material describes AI as producing first drafts that human experts then refine, and it describes human experts iterating upon what AI produces. The people involved decide what the ad should become.

Mistakes When Reading About AI Creative Tools

  • Common mistake

    Assuming the first AI draft is the final ad

    What it looks like

    A team publishes the first generated image without testing variants.

    Why it fails

    The workflow places audience testing after variation, and the chosen version comes from the test results.

    Do this instead

    Treat the first draft as a starting point, then vary and test before choosing.

  • Common mistake

    Treating a probabilistic output as a fixed answer

    What it looks like

    Expecting a generator to return the same image every time it is asked.

    Why it fails

    A probabilistic generator's results can differ from one attempt to the next.

    Do this instead

    Expect variety, and use it when many acceptable answers exist.

  • Common mistake

    Reading the AI-by-default prediction as a reported fact

    What it looks like

    Stating that all graphics apps will drop AI from their names.

    Why it fails

    The material presents this as the author's suspicion, not as a reported fact.

    Do this instead

    Label it as the author's opinion.

  • Common mistake

    Confusing the attitude change with a change in the image itself

Trace a Creative Task Yourself

What do you think happens?

Before reading the last stage, predict which step decides the final advertisement: the first AI draft or audience testing?

  • The first AI draft

  • Audience testing

Reveal answer
Answer:

Audience testing

The chosen version is picked from the test results, not from the first draft.

MEDIUM

An enterprise wants a video advertisement for three regions, each with a different holiday. Describe the workflow in order: where AI starts, where human experts act, which variants are made, how audience testing is used, and what decides the final choice.

Hints
  • Start with what AI produces first.
  • Remember that variants are made before testing.
  • The final choice comes from the test results.

Summary of the Workflow and Its Reasons

  1. 1
    Creative tasks suit AI's probabilistic nature because a generator's results can differ between attempts, and many creative tasks have several good answers.
  2. 2
    Named tools include Midjourney for image generation, Adobe Firefly for photo editing, and Runway, Pika Labs, and Sora for video generation.
  3. 3
    AI-generated profile pictures moved from a banned practice in 2019 to a built-in feature in many social media apps by 2023.
  4. 4
    An enterprise ad workflow runs from AI first draft, to human refinement, to variants for seasonal or location needs, to audience testing, with the chosen version coming from the test results.
  5. 5
    Human experts refine AI drafts and shape the final result, so AI starts the process and people shape it.

At a glance

  • Creative tasks suit AI's probabilistic nature because results can vary between attempts and many creative tasks have several good answers.
  • Named tools include Midjourney for image generation, Adobe Firefly for photo editing, and Runway, Pika Labs, and Sora for video generation.
  • AI-generated profile pictures moved from a banned practice in 2019 to a built-in feature in many social media apps by 2023.
  • The enterprise ad workflow runs from AI first draft through human refinement and variants to audience testing, and the chosen version comes from the test results.
  • Human experts refine AI drafts, so AI starts the process and people shape the result.

More concepts starting with G