Fast and stable MAP-Elites in noisy domains using deep grids by Flageat, M., & Cully, A. (2020)

source
(Flageat and Cully 2020)
tags
ALife 2020, MAP-Elites, Quality diversity

Summary

MAP-Elites can be problematic in face of uncertainty because:

  • individuals can be unexpectedly lucky
  • the behavior space can be hard to estimate and result in misplacing individuals.

Some mitigation techniques have been explored, e.g in (Justesen, Risi, and Mouret 2019) and this paper is about introducing another way of dealing with noisy domains without using sampling.

Here the main idea is to replace the MAP-elites grid by a “deep grid” with another dimension. This other dimension is used to store a population of individuals instead of a single individual for each elite. For each mutation, a single individual from the population is selected.

Slide from the Alife talk

Experiments show that deep grids are a data efficient extension of MAP-elites which enable reducing uncertainty on the behavior descriptors.

Bibliography

Flageat, Manon, and Antoine Cully. 2020. “Fast and Stable MAP-Elites in Noisy Domains Using Deep Grids.” Artificial Life Conference Proceedings 32 (July). MIT Press:273–82.

Justesen, Niels, Sebastian Risi, and Jean-Baptiste Mouret. 2019. “MAP-Elites for Noisy Domains by Adaptive Sampling.” In Proceedings of the Genetic and Evolutionary Computation Conference Companion, 121–22. GECCO ’19. Prague, Czech Republic: Association for Computing Machinery.


← Back to Notes