Exploring the impact of novelty and objective-directed evolution in company with MAP-Elites and HyperNEAT

Breytenbach, Jeremy

Exploring the impact of novelty and objective-directed evolution in company with MAP-Elites and HyperNEAT

Thesis / Dissertation

2025

Publisher

University of Cape town

Department

Department of Computer Science

Faculty

Faculty of Science

Abstract

Collective robotics refers to the field of robotics that focuses on the coordination and collaboration of multiple agents to perform a task or solve a problem. The ability to automatically design controllers for such agents in a collective system is an attractive proposition. In this thesis we investigate the impact on performance of combining MAP-Elites with HyperNEAT while varying the evolutionary search directive between an objective and non-objective search, and a hybrid approach. Objective search refers to evolutionary algorithms that explicitly optimize a predetermined performance metric, whereas nonobjective search refers to evolutionary approaches that primarily focuses on exploration and diversity within the search space. HyperNEAT is an evolutionary method that makes use of indirect encoding to evolve agents. Whereas in typical evolutionary methods, only the fittest agents survive to future generations, the inclusion of MAP-Elites allows not only the fittest agents but also those that demonstrate unique behaviour to survive (the elites). MAP-Elites is referred to as an illumination algorithm because by retaining these elite agents in the population, we expect to increase the chances of exploring and thus illuminating novel, yet potentially high-performing regions of the search space. To evaluate these methods, we use Keep-away, a simulated collective robotics task within the RoboCup football framework as a case study. In Keep-away, a team of "keeper" robots attempt to maintain possession of the football while opposing "taker" robots try to intercept it. For this study, we produced controllers for the keeper agents. This research report sheds light on how the combination of these methods affects the agents' performance and their ability explore the behaviour search space. The insights gained from this study will be valuable for researchers working to understand the value and applicability of combining illumination algorithms such as MAP-Elites with objective and non-objective search for gaining performance in Keep-away and similar tasks.

Keywords

Computer Science

Reference:

Collections

Masters

Full item page