%0 Journal Article %T An Open-Source Software Framework for Reinforcement Learning-based Control of Tracked Robots in Simulated Indoor Environments %+ Equipe Robot interaction, Ambient system, Machine learning, Behaviour, Optimization (Lab-STICC_RAMBO) %+ Département Informatique (IMT Atlantique - INFO) %A Mitriakov, A %A Papadakis, Panagiotis %A Garlatti, Serge %Z Brest Métropole, Région Bretagne %< avec comité de lecture %@ 0169-1864 %J Advanced Robotics %I Taylor & Francis %S Special Issue on Software Framework for Robot System Integration %V 36 %N 11 %8 2022-05-24 %D 2022 %R 10.1080/01691864.2022.2076570 %K Reinforcement learning %K robot control %K incremental learning %K domain randomizaion %K staircase negotiation %K tracked robots %Z Computer Science [cs]/Artificial Intelligence [cs.AI] %Z Computer Science [cs]/Modeling and Simulation %Z Computer Science [cs]/Robotics [cs.RO]Journal articles %X A simulation framework based on the open-source robotic software Gazebo and the Robot Operating System (ROS) is presented for articulated tracked robots, designed for reinforcement learning-based (RL) control skill acquisition. In particular, it is destined to serve as a research tool in the development and evaluation of methods in the domain of mobility learning for articulated tracked robots, in 3D indoor environments. Its architecture allows to interchange between different RL libraries and algorithm implementations, while learning can be customized to endow specific properties within a control skill. To demonstrate its utility, we focus on the most demanding case of staircase ascent and descent using depth image data, while respecting safety via reward function shaping and incremental, domain randomization-based, end-to-end learning. %G English %2 https://imt-atlantique.hal.science/hal-03671418/document %2 https://imt-atlantique.hal.science/hal-03671418/file/main.pdf %L hal-03671418 %U https://imt-atlantique.hal.science/hal-03671418 %~ UNIV-BREST %~ INSTITUT-TELECOM %~ CNRS %~ UNIV-UBS %~ ENIB %~ LAB-STICC %~ TDS-MACS %~ IMTA_INFO %~ LAB-STICC_IMTA %~ IMT-ATLANTIQUE %~ INSTITUTS-TELECOM %~ LAB-STICC_RAMBO_IMTA %~ LAB-STICC_RAMBO %~ LAB-STICC_INTERACTION