The robots are collaborating.
Teaching a robot how to grasp a pen seems like an innocent enough project. But researchers at Brown University, DexNet, and Google Research (among others) are exploring the ways in which their robots could store the data that comes from thousands of practice attempts in the cloud, to be downloaded later by other robots who need the same skills. Now it’s not just about picking up objects, but about massive data transfers between robots.
In the grasping experiments, human intervention was limited, but still necessary. Researchers wrote the algorithms, made sure the devices were powered, and added new objects to the mix during the experiment, but it was the robots that had to “learn” to adjust their movements through multiple attempts. And it was the robots that then uploaded this data (every mistake, the circumstances for every success) into the cloud for other robots to download. Not unlike a small child learning to hold something correctly for the first time, the robots then become more adept and build on this knowledge.
Combine this with the EU’s Horizon 2020-funded project RobDREAM, which aims to enable robots to enhance their capabilities and consolidate information while in their inactive phase (while they are powered down, or “sleeping”). The goal is to use this inactive phase to continue processing experiences made during the working day. RobDREAM also wants their robots to process, or “dream,” of other possible situations they may encounter and how they would operate under those conditions to be successful. RobDREAM also has an autonomous component, allowing the robots to make alterations to their routines based on the data they have processed. A robot cloud would allow for even more experience transfer.
We were warned about the technology first in 2015 when Tesla programmed their driverless cars to learn from each other. Soon we’ll find out how much more can be achieved when the robots share data from their “dreams.”
It’s helpful when our devices cooperate with one another, but this is a whole new can of worms. We’re not days from being incapacitated by teams of robots working together, but there are important questions that scientists, citizens, and policymakers alike should ask, such as: How will we regulate information in the cloud? How much autonomy should we give to our robotic aides when it comes to sharing and downloading information? Can the robot or cloud be hacked to download dangerous information? How eager should we be to cut humans out of the learning process?
Project RobDREAM (official website)
How Google wants to solve robotic grasping by letting robots learn for themselves (IEEE Spectrum, 2016)
Robots that teach each other (MIT Technology Review, 2016)
Google is using machine learning to teach robots how to grasp random objects (Tech Crunch, 2016)
Learning to grasp objects with multiple contact points (Stanford, 2016)