Improving the Morphology and Control Policy of Self-reconfiguring Modular Robots in Dynamic Environment (Student Abstract)

Authors

  • Dong Xue China University of Petroleum-Beijing
  • Qiang Lu China University of Petroleum-Beijing
  • Jian Li China University of Petroleum-Beijing

Keywords:

Evolutionary Computation, Multi-Robot Systems, Robotics

Abstract

Ideally, self-reconfiguration modular robots (SMR) can change their morphology and perform actions related to a specific task in any scene. However, most SMRs only adapt to several specific scenes because their morphology and control policies are designed or trained based on these scenes. Once SMRs meet an unknown scene, especially multiply unknown scenes (called dynamic environment), these policies will be useless. Although some of these policies import evolutionary algorithms to enhance the ability of SMR to explore unknown scenes, they are very time-consuming. The reason is that individual fitness depends on the interaction between SMR and these scenes. We propose a two-stage reconfiguration algorithm (TSRA) without any prior knowledge to address the time-consuming problem. In the two stages, the reconfiguration methods use the evolutionary algorithm (GA) to simultaneously generate scene-fitted morphology and actions. The first stage method uses the estimation neural network to evaluate the individual fitness to run faster and can recommend better policies to the second stage. The second stage method obtains this fitness from scenes and updates the neural network to approximate these scenes. Through experiments, TSRA can find better morphology and control policies than the other two canonical algorithms --- GA and GEM-RL.

Downloads

Published

2021-05-18

How to Cite

Xue, D., Lu, Q., & Li, J. (2021). Improving the Morphology and Control Policy of Self-reconfiguring Modular Robots in Dynamic Environment (Student Abstract). Proceedings of the AAAI Conference on Artificial Intelligence, 35(18), 15939-15940. Retrieved from https://ojs.aaai.org/index.php/AAAI/article/view/17966

Issue

Section

AAAI Student Abstract and Poster Program