SimpleRNN networks
The Keras example uses an LSTM layer in a model trained on IMDB data.
From SimpleRNN to LSTM
The LSTM example is not presented as an entirely new model design. Its overall network structure is similar to the SimpleRNN network shown immediately before it. The important change is the recurrent layer: the example uses an LSTM layer instead of a SimpleRNN layer.
The LSTM Layer's Place
An LSTM layer is used as a layer inside a Keras model. In this example, the model is trained on IMDB data. The layer therefore belongs to the model's network structure; it is not being discussed as a separate program or a replacement for the whole Keras model.
The central comparison is structural: both examples use a Keras model trained on IMDB data, while the recurrent layer changes from SimpleRNN to LSTM.
The Explicit Configuration
Reading the LSTM example's configuration
Determine which part of the LSTM configuration the example chooses directly and which parts it leaves to Keras.
Identify the deliberate setting: The example explicitly specifies the output dimensionality of the LSTM layer.
Check the remaining arguments: Every other LSTM argument is left unspecified in the example, so the example relies on Keras defaults for them.
Connect configuration to purpose: This keeps the example focused on using an LSTM layer in a model while avoiding manual configuration of every available argument.
The explicitly chosen setting is the LSTM layer's output dimensionality. The remaining LSTM arguments use Keras defaults.
Why Defaults Matter
The example leaves the other LSTM arguments at their Keras defaults as a practical choice. The source presents Keras as having good defaults, so models will almost always work without requiring the developer to tune parameters by hand.
In this example, the developer makes one configuration choice that the source calls out explicitly: the LSTM layer's output dimensionality. Rather than manually supplying every other LSTM argument, the developer lets Keras provide its defaults. This keeps the model definition concise while following the practical approach recommended by the example.
Treating the LSTM as a replacement for the entire Keras model
The source says that the LSTM is a layer inside a Keras model and that the overall network structure is similar to the preceding SimpleRNN network.
Fix:
Describe the change as a substitution of the recurrent layer within a similar Keras model structure.Claiming that every LSTM argument is manually configured
The example explicitly specifies the output dimensionality and leaves all other LSTM arguments at Keras defaults.
Fix:
Separate the one explicitly specified setting from the remaining arguments supplied by Keras defaults.Inventing a numeric output dimensionality
The supplied material identifies the setting but does not provide a numeric value.
Fix:
Refer to the output dimensionality without adding an unsupported number.
Training on IMDB Data
The practical goal of the example is to train the Keras model on IMDB data. The IMDB examples provide the data used for training, and the LSTM layer is one part of the network that processes that data as the model is trained. The important lesson here is how the LSTM fits into the model and how the example configures it, not a new overall network structure.
What do you think happens?
What is the main architectural difference between the preceding SimpleRNN example and this LSTM example?
Reveal answer
Answer: The recurrent layer changes from SimpleRNN to LSTM.
The source describes the overall network structure as similar and identifies the recurrent layer as the important change.
Training on IMDB data gives the model its practical task. The LSTM example demonstrates that this task can use an LSTM recurrent layer while retaining a structure similar to the preceding SimpleRNN network.
Check Your Understanding
Explain the LSTM example in three parts: first, state the role of the LSTM layer in the Keras model; second, identify the one LSTM setting specified explicitly; third, explain why the other arguments are left unspecified.
Hints
- Compare the LSTM example with the preceding SimpleRNN network.
- The explicitly specified setting describes the layer's output.
- Use the source's practical reason for relying on Keras defaults.
Key Takeaways
- The LSTM example uses an LSTM layer inside a Keras model trained on IMDB data.
- Its overall network structure is similar to the preceding SimpleRNN network.
- The important architectural change is replacing the SimpleRNN recurrent layer with an LSTM layer.
- The example explicitly specifies the LSTM layer's output dimensionality.
- All other LSTM arguments are left at Keras defaults because Keras provides good defaults and models will almost always work without hand-tuning every parameter.
Key Takeaways
- An LSTM layer is a recurrent layer used inside a Keras model.
- The LSTM example keeps a structure similar to the preceding SimpleRNN network while changing the recurrent layer.
- The example explicitly specifies output dimensionality and leaves the remaining LSTM arguments at Keras defaults.
- The model is trained on IMDB data, providing the practical training task for the example.