Skip to Content
Download the full-sized PDF of Predictive Collaborative Robots via Deep Reinforcement Learning
Download the full sized image


Download  |  Analytics  |  Citations

Export to: EndNote  |  Zotero  |  Mendeley


This file is not currently in any collections.

Predictive Collaborative Robots via Deep Reinforcement Learning Open Access

In recent years, advances in the field of collaborative robotics have enabled people and robots to work in a shared environment. However, the complexity of modeling human-robot interaction and difficulty of automating many tasks has restricted the application range of collaborative robots. This research introduces a model free reinforcement learning-based framework capable of learning to perform new tasks, as well as learning the human behaviors associated with those tasks, enabling a robotic system to work directly with people to complete a shared objective. By utilizing data captured from a camera mounted above the workspace, this framework acts as an adaptive control system that enables a collaborative robot to adjust to changes in its environment in real time. First, a classification neural network is trained to model the probability distribution of human behaviors associated with a specific task based on data collected on that task being performed. Then, a Deep Q Network is trained in simulation, converging to an optimal decision policy based on the rewards it receives for the outcomes of actions it selects. In contrast to traditional approaches to programming robots, this system 'learns' generalizable policies that allow it to adapt to dynamic environments, enabling high levels of performance in scenarios it has never encountered before. This system was implemented on a collaborative assembly task both in simulation and in physical space, in which the objective was to assemble a series of parts in a specific order in collaboration with a person. This resulted in an average efficiency increase 21.6% over the person working alone while maintaining a high standard of safety. This novel approach to addressing human-robot interaction enables collaborative robots to become predictive rather than reactive, resulting in safer and more efficient collaboration.


Barnes, Scott
Wickenheiser, Adam
GW Unit
Mechanical & Aerospace Engineering
Date Created
Type of Work
Attribution-ShareAlike 3.0 United States

Research Days 2017
Collaborative robotics
Deep reinforcement learning
Human-Robot interaction
Related URL
Previous Publication Information
Persistent Link

File Details

Leah Richardson
Date Uploaded
Date Modified
Audit Status
Audits have not yet been run on this file.
File format: pdf (Portable Document Format)
Mime type: application/pdf
File size: 1344640
Last modified: 2017:05:18 14:40:36-04:00
Filename: scott barnes ss submission.pdf
Original checksum: a2ffa84d74e00dd0cb80d5e9887843c0
Well formed: true
Valid: true
File title: PowerPoint Presentation
File author: Joyce
Page count: 1
File language: en-US
Activity of users you follow
User Activity Date