Journal of University of Science and Technology of China ›› 2019, Vol. 49 ›› Issue (10): 812-819.DOI: 10.3969/j.issn.0253-2778.2019.10.006

• Original Paper • Previous Articles     Next Articles

Robot control policy transfer based on progressive neural network

SUI Hongjian, SHANG Weiwei, LI Xiang, CONG Shuang   

  1. Department of Automation,University of Science and Technology of China, Hefei 230027
  • Received:2018-12-24 Revised:2019-05-16 Accepted:2019-05-16 Online:2019-10-31 Published:2019-05-16

Abstract: In the field of robotic control, it is appealing to solve complicated control tasks through deep learning techniques. However, collecting enough robot operating data to train deep learning models is difficult. Thus, in this paper a transfer approach based on progressive neural network (PNN) and deep deterministic policy gradient (DDPG) is proposed. By linking the current task model and pretrained task models in the model pool with a novel structure, the control strategy in the pretrained task models is transferred to the current task model. Simulation experiments validate that, the proposed approach can successfully transfer control policies learned from the source task to the current task. And compared with other baselines, the proposed approach takes remarkably less time to achieve the same performance in all the experiments.

Key words: robot control, transfer learning, deep reinforcement learning, progressive neural network

CLC Number: