Gait Control of Humanoid Robot with Toe Joints Based on Reinforcement Learning

Message:
Article Type:
Research/Original Article (دارای رتبه معتبر)
Abstract:
Controlling a humanoid robot is a complicated task because it deals with a high degree of freedom, a non-holonomic and underactuated system. Many model-based control strategies have been implied on humanoid robots. Over time model-free and AI-based strategies have taken place. Among AI strategies, Reinforcement Learning has the largest share. Many complex systems have successfully controlled to perform complicated tasks such as jumping and running. Toe joints is almost missing in all of these systems and does not have the application it performs in humans. Toed robots can outperform, so implementing Reinforcement Learning algorithms on a humanoid with an active toe joint has been studied. Two algorithms, DDPG, and TD3 were applied and compared. A customized RL framework was designed to teach a humanoid to walk. Simulations showed that the task of controlling a humanoid to walk was accomplished. Learned robot was able to gait on a flat surface at the average speed of 0.9 m/s.
Language:
Persian
Published:
Iranian Journal of Mechanical Engineering, Volume:26 Issue: 3, 2024
Pages:
29 to 44
https://www.magiran.com/p2810015