Manon Flageat
Benchmarking Quality-Diversity Algorithms on Neuroevolution for Reinforcement Learning
Flageat, Manon; Lim, Bryan; Grillotti, Luca; Allard, Maxime; Smith, Simόn C; Cully, Antoine
Authors
Bryan Lim
Luca Grillotti
Maxime Allard
Simόn C Smith
Antoine Cully
Abstract
We present a Quality-Diversity benchmark suite for Deep Neuroevolution in Reinforcement Learning domains for robot control. The suite includes the definition of tasks, environments, behavioral descriptors, and fitness. We specify different benchmarks based on the complexity of both the task and the agent controlled by a deep neural network. The benchmark uses standard Quality-Diversity metrics, including coverage, QD-score, maximum fitness, and an archive profile metric to quantify the relation between coverage and fitness. We also present how to quantify the robustness of the solutions with respect to environmental stochasticity by introducing corrected versions of the same metrics. We believe that our benchmark is a valuable tool for the community to compare and improve their findings. The source code is available online.
Presentation Conference Type | Conference Paper (unpublished) |
---|---|
Conference Name | Gecco 2022 |
Start Date | Jul 9, 2022 |
End Date | Jul 13, 2022 |
Deposit Date | Jul 11, 2023 |
DOI | https://doi.org/10.48550/arXiv.2211.02193 |
Keywords | Quality-Diversity, Evolutionary algorithms |
You might also like
Counterfactual Explanation and Causal Inference In Service of Robustness in Robot Control
(2020)
Presentation / Conference Contribution
Clustering-Based Searching and Navigation in an Online News Source
(2006)
Presentation / Conference Contribution
Evaluation of Internal Models in Autonomous Learning
(2018)
Journal Article
Hierarchical quality-diversity for online damage recovery
(2022)
Presentation / Conference Contribution
Downloadable Citations
About Edinburgh Napier Research Repository
Administrator e-mail: repository@napier.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search