فهرست مطالب
Evolutionary Deep Learning
brief contents
contents
preface
acknowledgments
about this book
Who should read this book
How this book is organized: A road map
About the code
liveBook discussion forum
about the author
about the cover illustration
Part 1: Getting started
Chapter 1: Introducing evolutionary deep learning
1.1 What is evolutionary deep learning?
1.1.1 Introducing evolutionary computation
1.2 The why and where of evolutionary deep learning
1.3 The need for deep learning optimization
1.3.1 Optimizing the network architecture
1.4 Automating optimization with automated machine learning
1.4.1 What is automated machine learning?
1.5 Applications of evolutionary deep learning
1.5.1 Model selection: Weight search
1.5.2 Model architecture: Architecture optimization
1.5.3 Hyperparameter tuning/optimization
1.5.4 Validation and loss function optimization
1.5.5 Neuroevolution of augmenting topologies
1.5.6 Goals
Chapter 2: Introducing evolutionary computation
2.1 Conway’s Game of Life on Google Colaboratory
2.2 Simulating life with Python
2.2.1 Learning exercises
2.3 Life simulation as optimization
2.3.1 Learning exercises
2.4 Adding evolution to the life simulation
2.4.1 Simulating evolution
2.4.2 Learning exercises
2.4.3 Some background on Darwin and evolution
2.4.4 Natural selection and survival of the fittest
2.5 Genetic algorithms in Python
2.5.1 Understanding genetics and meiosis
2.5.2 Coding genetic algorithms
2.5.3 Constructing the population
2.5.4 Evaluating fitness
2.5.5 Selecting for reproduction (crossover)
2.5.6 Applying crossover: Reproduction
2.5.7 Applying mutation and variation
2.5.8 Putting it all together
2.5.9 Understanding genetic algorithm hyperparameters
2.5.10 Learning exercises
Chapter 3: Introducing genetic algorithms with DEAP
3.1 Genetic algorithms in DEAP
3.1.1 One max with DEAP
3.1.2 Learning exercises
3.2 Solving the Queen’s Gambit
3.2.1 Learning exercises
3.3 Helping a traveling salesman
3.3.1 Building the TSP solver
3.3.2 Learning exercises
3.4 Selecting genetic operators for improved evolution
3.4.1 Learning exercises
3.5 Painting with the EvoLisa
3.5.1 Learning exercises
Chapter 4: More evolutionar y computation with DEAP
4.1 Genetic programming with DEAP
4.1.1 Solving regression with genetic programming
4.1.2 Learning exercises
4.2 Particle swarm optimization with DEAP
4.2.1 Solving equations with PSO
4.2.2 Learning exercises
4.3 Coevolving solutions with DEAP
4.3.1 Coevolving genetic programming with genetic algorithms
4.4 Evolutionary strategies with DEAP
4.4.1 Applying evolutionary strategies to function approximation
4.4.2 Revisiting the EvoLisa
4.4.3 Learning exercises
4.5 Differential evolution with DEAP
4.5.1 Approximating complex and discontinuous functions with DE
4.5.2 Learning exercises
Part 2: Optimizing deep learning
Chapter 5: Automating hyperparameter optimization
5.1 Option selection and hyperparameter tuning
5.1.1 Tuning hyperparameter strategies
5.1.2 Selecting model options
5.2 Automating HPO with random search
5.2.1 Applying random search to HPO
5.3 Grid search and HPO
5.3.1 Using grid search for automatic HPO
5.4 Evolutionary computation for HPO
5.4.1 Particle swarm optimization for HPO
5.4.2 Adding EC and DEAP to automatic HPO
5.5 Genetic algorithms and evolutionary strategies for HPO
5.5.1 Applying evolutionary strategies to HPO
5.5.2 Expanding dimensions with principal component analysis
5.6 Differential evolution for HPO
5.6.1 Differential search for evolving HPO
Chapter 6: Neuroevolution optimization
6.1 Multilayered perceptron in NumPy
6.1.1 Learning exercises
6.2 Genetic algorithms as deep learning optimizers
6.2.1 Learning exercises
6.3 Other evolutionary methods for neurooptimization
6.3.1 Learning exercises
6.4 Applying neuroevolution optimization to Keras
6.4.1 Learning exercises
6.5 Understanding the limits of evolutionary optimization
6.5.1 Learning exercises
Chapter 7: Evolutionary convolutional neural networks
7.1 Reviewing convolutional neural networks in Keras
7.1.1 Understanding CNN layer problems
7.1.2 Learning exercises
7.2 Encoding a network architecture in genes
7.2.1 Learning exercises
7.3 Creating the mating crossover operation
7.4 Developing a custom mutation operator
7.5 Evolving convolutional network architecture
7.5.1 Learning exercises
Part 3: Advanced applications
Chapter 8: Evolving autoencoders
8.1 The convolution autoencoder
8.1.1 Introducing autoencoders
8.1.2 Building a convolutional autoencoder
8.1.3 Learning exercises
8.1.4 Generalizing a convolutional AE
8.1.5 Improving the autoencoder
8.2 Evolutionary AE optimization
8.2.1 Building the AE gene sequence
8.2.2 Learning exercises
8.3 Mating and mutating the autoencoder gene sequence
8.4 Evolving an autoencoder
8.4.1 Learning exercises
8.5 Building variational autoencoders
8.5.1 Variational autoencoders: A review
8.5.2 Implementing a VAE
8.5.3 Learning exercises
Chapter 9: Generative deep learning and evolution
9.1 Generative adversarial networks
9.1.1 Introducing GANs
9.1.2 Building a convolutional generative adversarial network in Keras
9.1.3 Learning exercises
9.2 The challenges of training a GAN
9.2.1 The GAN optimization problem
9.2.2 Observing vanishing gradients
9.2.3 Observing mode collapse in GANs
9.2.4 Observing convergence failures in GANs
9.2.5 Learning exercises
9.3 Fixing GAN problems with Wasserstein loss
9.3.1 Understanding Wasserstein loss
9.3.2 Improving the DCGAN with Wasserstein loss
9.4 Encoding the Wasserstein DCGAN for evolution
9.4.1 Learning exercises
9.5 Optimizing the DCGAN with genetic algorithms
9.5.1 Learning exercises
Chapter 10: NEAT: NeuroEvolution of Augmenting Topologies
10.1 Exploring NEAT with NEAT-Python
10.1.1 Learning exercises
10.2 Visualizing an evolved NEAT network
10.3 Exercising the capabilities of NEAT
10.3.1 Learning exercises
10.4 Exercising NEAT to classify images
10.4.1 Learning exercises
10.5 Uncovering the role of speciation in evolving topologies
10.5.1 Tuning NEAT speciation
10.5.2 Learning exercises
Chapter 11: Evolutionary learning with NEAT
11.1 Introducing reinforcement learning
11.1.1 Q-learning agent on the frozen lake
11.1.2 Learning exercises
11.2 Exploring complex problems from the OpenAI Gym
11.2.1 Learning exercises
11.3 Solving reinforcement learning problems with NEAT
11.3.1 Learning exercises
11.4 Solving Gym’s lunar lander problem with NEAT agents
11.4.1 Learning exercises
11.5 Solving Gym’s lunar lander problem with a deep Q-network
Chapter 12: Evolutionary machine learning and beyond
12.1 Evolution and machine learning with gene expression programming
12.1.1 Learning exercises
12.2 Revisiting reinforcement learning with Geppy
12.2.1 Learning exercises
12.3 Introducing instinctual learning
12.3.1 The basics of instinctual learning
12.3.2 Developing generalized instincts
12.3.3 Evolving generalized solutions without instincts
12.3.4 Learning exercises
12.4 Generalized learning with genetic programming
12.4.1 Learning exercises
12.5 The future of evolutionary machine learning
12.5.1 Is evolution broken?
12.5.2 Evolutionary plasticity
12.5.3 Improving evolution with plasticity
12.5.4 Computation and evolutionary search
12.6 Generalization with instinctual deep and deep reinforcement learning
appendix
A.1 Accessing the source code
A.2 Running code on other platforms
index
A
B
C
D
E
F
G
H
I
K
L
M
N
O
P
Q
R
S
T
U
V
W
brief contents
contents
preface
acknowledgments
about this book
Who should read this book
How this book is organized: A road map
About the code
liveBook discussion forum
about the author
about the cover illustration
Part 1: Getting started
Chapter 1: Introducing evolutionary deep learning
1.1 What is evolutionary deep learning?
1.1.1 Introducing evolutionary computation
1.2 The why and where of evolutionary deep learning
1.3 The need for deep learning optimization
1.3.1 Optimizing the network architecture
1.4 Automating optimization with automated machine learning
1.4.1 What is automated machine learning?
1.5 Applications of evolutionary deep learning
1.5.1 Model selection: Weight search
1.5.2 Model architecture: Architecture optimization
1.5.3 Hyperparameter tuning/optimization
1.5.4 Validation and loss function optimization
1.5.5 Neuroevolution of augmenting topologies
1.5.6 Goals
Chapter 2: Introducing evolutionary computation
2.1 Conway’s Game of Life on Google Colaboratory
2.2 Simulating life with Python
2.2.1 Learning exercises
2.3 Life simulation as optimization
2.3.1 Learning exercises
2.4 Adding evolution to the life simulation
2.4.1 Simulating evolution
2.4.2 Learning exercises
2.4.3 Some background on Darwin and evolution
2.4.4 Natural selection and survival of the fittest
2.5 Genetic algorithms in Python
2.5.1 Understanding genetics and meiosis
2.5.2 Coding genetic algorithms
2.5.3 Constructing the population
2.5.4 Evaluating fitness
2.5.5 Selecting for reproduction (crossover)
2.5.6 Applying crossover: Reproduction
2.5.7 Applying mutation and variation
2.5.8 Putting it all together
2.5.9 Understanding genetic algorithm hyperparameters
2.5.10 Learning exercises
Chapter 3: Introducing genetic algorithms with DEAP
3.1 Genetic algorithms in DEAP
3.1.1 One max with DEAP
3.1.2 Learning exercises
3.2 Solving the Queen’s Gambit
3.2.1 Learning exercises
3.3 Helping a traveling salesman
3.3.1 Building the TSP solver
3.3.2 Learning exercises
3.4 Selecting genetic operators for improved evolution
3.4.1 Learning exercises
3.5 Painting with the EvoLisa
3.5.1 Learning exercises
Chapter 4: More evolutionar y computation with DEAP
4.1 Genetic programming with DEAP
4.1.1 Solving regression with genetic programming
4.1.2 Learning exercises
4.2 Particle swarm optimization with DEAP
4.2.1 Solving equations with PSO
4.2.2 Learning exercises
4.3 Coevolving solutions with DEAP
4.3.1 Coevolving genetic programming with genetic algorithms
4.4 Evolutionary strategies with DEAP
4.4.1 Applying evolutionary strategies to function approximation
4.4.2 Revisiting the EvoLisa
4.4.3 Learning exercises
4.5 Differential evolution with DEAP
4.5.1 Approximating complex and discontinuous functions with DE
4.5.2 Learning exercises
Part 2: Optimizing deep learning
Chapter 5: Automating hyperparameter optimization
5.1 Option selection and hyperparameter tuning
5.1.1 Tuning hyperparameter strategies
5.1.2 Selecting model options
5.2 Automating HPO with random search
5.2.1 Applying random search to HPO
5.3 Grid search and HPO
5.3.1 Using grid search for automatic HPO
5.4 Evolutionary computation for HPO
5.4.1 Particle swarm optimization for HPO
5.4.2 Adding EC and DEAP to automatic HPO
5.5 Genetic algorithms and evolutionary strategies for HPO
5.5.1 Applying evolutionary strategies to HPO
5.5.2 Expanding dimensions with principal component analysis
5.6 Differential evolution for HPO
5.6.1 Differential search for evolving HPO
Chapter 6: Neuroevolution optimization
6.1 Multilayered perceptron in NumPy
6.1.1 Learning exercises
6.2 Genetic algorithms as deep learning optimizers
6.2.1 Learning exercises
6.3 Other evolutionary methods for neurooptimization
6.3.1 Learning exercises
6.4 Applying neuroevolution optimization to Keras
6.4.1 Learning exercises
6.5 Understanding the limits of evolutionary optimization
6.5.1 Learning exercises
Chapter 7: Evolutionary convolutional neural networks
7.1 Reviewing convolutional neural networks in Keras
7.1.1 Understanding CNN layer problems
7.1.2 Learning exercises
7.2 Encoding a network architecture in genes
7.2.1 Learning exercises
7.3 Creating the mating crossover operation
7.4 Developing a custom mutation operator
7.5 Evolving convolutional network architecture
7.5.1 Learning exercises
Part 3: Advanced applications
Chapter 8: Evolving autoencoders
8.1 The convolution autoencoder
8.1.1 Introducing autoencoders
8.1.2 Building a convolutional autoencoder
8.1.3 Learning exercises
8.1.4 Generalizing a convolutional AE
8.1.5 Improving the autoencoder
8.2 Evolutionary AE optimization
8.2.1 Building the AE gene sequence
8.2.2 Learning exercises
8.3 Mating and mutating the autoencoder gene sequence
8.4 Evolving an autoencoder
8.4.1 Learning exercises
8.5 Building variational autoencoders
8.5.1 Variational autoencoders: A review
8.5.2 Implementing a VAE
8.5.3 Learning exercises
Chapter 9: Generative deep learning and evolution
9.1 Generative adversarial networks
9.1.1 Introducing GANs
9.1.2 Building a convolutional generative adversarial network in Keras
9.1.3 Learning exercises
9.2 The challenges of training a GAN
9.2.1 The GAN optimization problem
9.2.2 Observing vanishing gradients
9.2.3 Observing mode collapse in GANs
9.2.4 Observing convergence failures in GANs
9.2.5 Learning exercises
9.3 Fixing GAN problems with Wasserstein loss
9.3.1 Understanding Wasserstein loss
9.3.2 Improving the DCGAN with Wasserstein loss
9.4 Encoding the Wasserstein DCGAN for evolution
9.4.1 Learning exercises
9.5 Optimizing the DCGAN with genetic algorithms
9.5.1 Learning exercises
Chapter 10: NEAT: NeuroEvolution of Augmenting Topologies
10.1 Exploring NEAT with NEAT-Python
10.1.1 Learning exercises
10.2 Visualizing an evolved NEAT network
10.3 Exercising the capabilities of NEAT
10.3.1 Learning exercises
10.4 Exercising NEAT to classify images
10.4.1 Learning exercises
10.5 Uncovering the role of speciation in evolving topologies
10.5.1 Tuning NEAT speciation
10.5.2 Learning exercises
Chapter 11: Evolutionary learning with NEAT
11.1 Introducing reinforcement learning
11.1.1 Q-learning agent on the frozen lake
11.1.2 Learning exercises
11.2 Exploring complex problems from the OpenAI Gym
11.2.1 Learning exercises
11.3 Solving reinforcement learning problems with NEAT
11.3.1 Learning exercises
11.4 Solving Gym’s lunar lander problem with NEAT agents
11.4.1 Learning exercises
11.5 Solving Gym’s lunar lander problem with a deep Q-network
Chapter 12: Evolutionary machine learning and beyond
12.1 Evolution and machine learning with gene expression programming
12.1.1 Learning exercises
12.2 Revisiting reinforcement learning with Geppy
12.2.1 Learning exercises
12.3 Introducing instinctual learning
12.3.1 The basics of instinctual learning
12.3.2 Developing generalized instincts
12.3.3 Evolving generalized solutions without instincts
12.3.4 Learning exercises
12.4 Generalized learning with genetic programming
12.4.1 Learning exercises
12.5 The future of evolutionary machine learning
12.5.1 Is evolution broken?
12.5.2 Evolutionary plasticity
12.5.3 Improving evolution with plasticity
12.5.4 Computation and evolutionary search
12.6 Generalization with instinctual deep and deep reinforcement learning
appendix
A.1 Accessing the source code
A.2 Running code on other platforms
index
A
B
C
D
E
F
G
H
I
K
L
M
N
O
P
Q
R
S
T
U
V
W