Concepts / What Is a Deep Neural Network

What Is a Deep Neural Network

A deep learning system is therefore also a machine learning system and also an AI system.

  • Programming

Why One System Has Many Labels

News coverage often describes large language models as AI models. That is true, but the vocabulary can quickly become tangled. A large language model is also a type of deep neural network, and PyTorch, the library this course is about, is a deep learning library. So a single system can be described with several overlapping labels at once. This article untangles those labels by treating the three words as nested circles rather than as three unrelated topics.

What do you think happens?

A news article calls a large language model an AI model. Before reading on, which of these three terms is the broadest?

  • Artificial intelligence

  • Machine learning

  • Deep learning

Reveal answer
Answer:

Artificial intelligence

Artificial intelligence is the broadest term. Machine learning is a subfield of AI, and deep learning is a subcategory of machine learning, so deep learning is the narrowest of the three.

Three Terms as Nested Circles

The three terms form a containment chain. Artificial intelligence is the outermost circle. Inside it sits machine learning, and inside machine learning sits deep learning. Each inner circle inherits everything that is true of the circles around it. A deep learning system is therefore also a machine learning system and also an AI system.

Artificialintelligencetasks that usually needhuman intelligenceMachine learningalgorithms that learn fromdataDeep learningdeep neural networksLarge language modelsa type of deep neuralnetworkcontainscontainsincludes
Which field contains which, from broadest to narrowest, and where does a large language model fit?

Artificial Intelligence, Defined Broadly

Definition

Artificial intelligence is the broadest term: computer systems that perform tasks usually requiring human intelligence, such as understanding language, recognizing patterns, and making decisions.

The definition is deliberately broad. It describes a goal and a family of capabilities rather than a single technique. Any computer system that handles language, spots patterns, or chooses between options in a way that ordinarily takes human judgment falls under this umbrella. The source also notes that AI is still far from achieving general intelligence at the human level. In practice, the field describes systems that do specific tasks well, not systems that match people in every respect.

Machine Learning and the Missing Rulebook

The phrase without being explicitly programmed is the key to machine learning. In ordinary programming, a person writes the rules that the computer follows. In machine learning, the algorithm works out useful patterns from data, and it can improve as it receives more data and feedback. Machine learning is a subfield of AI for exactly this reason.

This shift is why machine learning moved AI beyond strict rule-based systems. A rule-based system can only handle what its author anticipated. A learning system can adapt to new inputs or changing environments instead of relying only on rules written in advance.

Machine learning is not a side branch of AI. The source describes it as integral to the evolution of AI, and it is the technology behind many advances visible today, including large language models. Recommendation systems used by online retailers and streaming services, email spam filtering, voice recognition in virtual assistants, and self-driving cars all appear in the source as machine learning applications.

What the Word Deep Refers To

Deep learning is a subcategory of machine learning that trains and applies deep neural networks. The word deep does not mean difficult or advanced in a vague sense. The source is specific: the deep in deep learning refers to the multiple hidden layers of artificial neurons or nodes.

Hidden here means the layers that sit between the data going in and the result coming out. Data enters the network at one end, passes through a series of intermediate layers, and produces a result at the other end. The depth of the network is a property of how many of these intermediate layers it has. These layers are what let a network model complex, nonlinear relationships in data.

Input dataraw images, audio, or textHidden layer 1artificial neurons or nodesHidden layer 2intermediate layerMore hidden layersdepth depends on how manyResultoutput of the networkpasses topasses topasses toproduces
How does raw input pass through successive hidden layers before it becomes a result?

Tracing a Large Language Model Through the Labels

Worked example

Placing one system in all three circles

Place a large language model inside the three nested terms, and state which facts from the source justify each placement.

  1. 1
    Check the outermost circle

    A large language model is a computer system that handles language, a task that usually requires human intelligence. It therefore falls under artificial intelligence.

  2. 2
    Check the middle circle

    Machine learning is the approach in which algorithms learn from data rather than being explicitly programmed for each task. Large language models are built with machine learning, so the system also sits inside machine learning.

  3. 3
    Check the innermost circle

    The source states that large language models are also a type of deep neural network. Deep learning trains and applies deep neural networks, so the system sits inside deep learning as well.

  4. 4
    Read the placement from the inside out

    Starting from the narrowest label and moving outward gives the full picture: deep learning, then machine learning, then artificial intelligence. Every outer label remains true.

Result

A large language model is a deep neural network, which is a deep learning system, which is also machine learning and artificial intelligence. The labels are nested, not competing.

Why Deep Learning Suits Unstructured Data

Deep learning is particularly well suited to unstructured data such as images, audio, and text, and this is the main reason it underpins large language models. The source contrasts this with traditional machine learning techniques, which excel at simple pattern recognition. Unstructured data does not arrive as neat rows and fixed columns, so the layered structure of a deep network is a good match for it.

Common Mistakes When Reading the Labels

  • Common mistake

    Treating AI, machine learning, and deep learning as three unrelated topics

    Why it fails

    The three terms form a containment chain. Machine learning is a subfield of AI, and deep learning is a subcategory of machine learning.

    Do this instead

    Read the terms as nested circles and place each new system inside all the circles that apply to it.

  • Common mistake

    Assuming deep means difficult or advanced

    Why it fails

    In this context, deep refers specifically to the multiple hidden layers of artificial neurons or nodes in the network.

    Do this instead

    When you see deep, ask how many hidden layers the network has between its input and its output.

  • Common mistake

    Assuming every AI system is a machine learning system

    Why it fails

    Machine learning is one subfield of AI. The AI definition covers any computer system performing tasks that usually require human intelligence, and not every such system learns from data.

    Do this instead

    Use machine learning only when the system learns patterns from data rather than following rules written in advance.

  • Common mistake

    Assuming AI today matches human-level intelligence in general

    Why it fails

    The source states that AI is still far from achieving general intelligence at the human level.

    Do this instead

    Describe current AI systems as doing specific tasks well, not as matching people in every respect.

  • Common mistake

    Assuming deep learning is the best choice for every kind of data

    Why it fails

    The source says deep learning is particularly well suited to unstructured data such as images, audio, and text, while traditional techniques excel at simple pattern recognition.

    Do this instead

    Consider the kind of data first, and remember that the strength of deep learning is tied to unstructured inputs.

Placing a Streaming Recommender

MEDIUM

A streaming service uses a system that recommends shows to each viewer based on past viewing. Using the three nested terms, decide which labels you can confidently apply from the source, and which would require more information about how the system is built.

Hints
  • The source lists recommendation systems used by streaming services as machine learning applications.
  • Artificial intelligence is the broadest label, so consider whether a recommender fits the definition of tasks that usually require human intelligence.
  • The source does not say every recommender is a deep neural network. Ask what you would need to know to place it in the innermost circle.

Key Takeaways

  • Artificial intelligence is the broadest term, covering computer systems that perform tasks usually requiring human intelligence, such as understanding language, recognizing patterns, and making decisions.
  • Machine learning is a subfield of AI in which algorithms learn patterns from data and improve with more data and feedback, rather than being explicitly programmed for each task.
  • Deep learning is a subcategory of machine learning that trains and applies deep neural networks, where deep refers to multiple hidden layers of artificial neurons or nodes.
  • The three terms nest as circles, so a system such as a large language model can be placed inside deep learning, machine learning, and AI all at once.
  • Deep learning is particularly well suited to unstructured data such as images, audio, and text, which is why it underpins large language models.

Related concepts

More concepts starting with W