UC Berkeley got Willow Garage's PR2 robot to fold towels perfectly. Rosie Jetson, eat your robot heart out.
Robots just got roped into doing some light housework. Researchers at UC Berkeley used Willow Garage’s PR2 robot to fold towels. The UCB programming used some innovative visual scanning allowing the PR2 to pick up a towel, find its corners, and fold it on a table perfectly. According to the paper presented at the 2010 ICRA, the robot successfully completed 50 out of 50 attempts to fold a single towel, and also folded 5 out of 5 towels when they were presented in a group. Is watching a robot do laundry really that exciting? Hell yes. We have a personal robot actually performing personal and useful tasks. It’s not dancing. It’s not welcoming you to an expo. It’s doing real work. That’s amazing. But you know what, forget all that, too! You know why this is really great? UC Berkeley used a Willow Garage robot to develop their own sophisticated robotics program. That validates the whole premise of the PR2 – faster development by letting researchers use a common platform. Score one for open source robotics!
I’ve been cheerleading for Willow Garage for a while now. Their approach to robotics exemplifies the new paradigms of innovation in the 21st century: distributed development, free exchange of information, and rapid leveraging of past successes into new prototypes. By building the PR2, Willow Garage essentially removed the burden of developing hardware from the UCB team. This let them skip the tedious creation of their own system and focus on the particular innovation they wanted to develop: a vision based detection system that can use geometry to overcome complex variations. Now, assuming that UCB will upload their code into the open source community, others can build on the work from there. This is how the field of robotics can be accelerated, and this is the deeper reason behind the celebration of this development.
Of course, watching robots fold towels is pretty frakkin’ awesome just on its own. The UC Berkeley team, under Professor Pieter Abbeel, has created a great algorithm for the PR2. It picks up a randomly folded towel it’s never seen before and twirls it until it finds a corner. Then it grasps that corner and finds the next until all corners are accounted for. Once the corners are identified the robot folds the towel and stacks them on a table. It’s elegant in its simplicity, complex in its visual recognition, and fun to watch when it’s sped up:
Just to show how robust the system is, here’s a challenging starting point with the towel partially folded and twisted in a complex way.
As cool as this project is, there’s obvious room for improvement. Speed is clearly an issue, but that may improve with processing power. Also, while the PR2 has a perfect score on successfully folding towels, this does not mean that it never committed an error in its trials. As mentioned in the ICRA paper, for 28 out of 50 towels the robot completed its task without a misstep, but in 22 trials there were some hiccups. These errors included missing a grab (16 trials), thinking it had grabbed a corner when it hadn’t (5), thinking it had not grabbed a corner when it had (3), incorrectly gripping a corner (4), unable to compensate for twists in the towel (3), and needing a complete start over (1). In each case though, the PR2 was able to continue on its algorithm (or start over) despite these errors and successfully complete its task. To me, that just means that Abbeel’s programming is more impressive because it’s robust.
No matter how rugged the PR2 and the towel folding code may be, I doubt that we’ll use humanoid bots for household chores. Specially crafted appliance-style robots can handle these tasks more efficiently and cheaply. But projects like this really demonstrate that personal robots can be workers as well as companion bots. As these machines become more self-sufficient (the PR2 can already plug itself in) they may be able to bring automation into places we’ve never seen it before.
Overall, I’m really excited about how the PR2 will advance personal robotics. It’s already helped UCB with a cool and novel application. Just think of what researchers may accomplish with this bot in the future. Don’t forget that Willow Garage is giving away 10 of these robots for free! This is a great time to watch how bots are going to evolve to take on a larger role in our lives. The next few years are going to be amazing and I can’t wait to see what UC Berkeley, Willow Garage, and the PR2 are going to do next.
Open source robotics for the win!
[image credit: Maitin-Shepard et al, ICRA 2010]
[video credits: UC Berkeley]
[source: UC Berkeley, Maitin-Shepard et al, ICRA 2010]
Tags: ICRA, Maitin-Shepard, open source, open source robotics, Pieter Abbeel, PR2, UC Berkeley, UCB, Willow Garage
Share
[...] Singularity Hub. [...]
The proof of concept here is amazing, but I’m not sure I’d call the video “stunning”.
Although to be fair, it is a little entrancing to watch the bot looking at each cloth and folding it in that repetitive pattern. The sped up video makes it watch like a stop-motion animated short.
This is the closest we’ve had to Rosie yet. Now they need to give it a old maid type voice and make it worry about people.
Anybody notice the background is solid green and all towels are colours different than green? I wonder how it will perform in a antural environment. That is not to say this achievement isn’t amazing, but I think we are still quite a way off from having practical household robots.
Visions systems are getting very good. I say this as a person who sees them used. A more advanced system doesn’t need the green screen at all.
That’s my point, do we have advanced enough vision systems that do not need a green or blue background? Or is it all just a replay of the 60ies when computers beating people at checkers brought the unrealistic expectation of achieving AI on par with human intellect in a decade? I think we should first solve the fundamental problems of vision and perception in general.
[...] writes “Researchers at UC Berkeley used Willow Garage’s PR2 robot to fold towels. The UCB programming used some innovative visual scanning techniques, allowing the PR2 to pick up a [...]
They should program it to put its hands on its hips and/or scratch its head when it realises it has to start again. At that point it will be ready for world domination.
Wow — this means that one day the clothes in my house might actually get folded for a change!
[...] Singularity Hub: Robots just got roped into doing some light housework. Researchers at UC Berkeley used Willow [...]
Seems like this would be a good thing for hospitals and hotels.
A slow but gradual move towards our very own Kryten. Next step on the roadmap should be a curry stain analyzer.
Give it a mobius loop towel and see what it does.
Big LOL
It calculates the theory of everything, then phases out of existence.
[...] Roboter der Handtücher falten kann geht seinen Weg durch das [...]
[...] mer och se mer video hos Singularity Hub. Tags handdukar, robot, strumpor, tvätt, vika Trackback URI Comments [...]
[...] Forscher aus Berkeley haben einen Roboter programmiert Handtücher zu falten. via [fefe.de] [...]
[...] http://singularityhub.com/2010/03/31/berkeley-gets-willow-garage-robot-to-fold-towels-simply-stunnin... [...]
[...] like Linux providing inspiration. We’ve also seen emerging trends in robotics lead by Willow Garage and their work with amazing research robots and operating software (ROS). Similar developments in synthetic biology are led by MIT’s [...]
[...] Berkeley Gets Willow Garage Robot to Fold Towels – Simply Stunning Video [...]
[...] Berkeley Gets Willow Garage Robot to Fold Towels – Simply Stunning Video [...]
[...] like Linux providing inspiration. We’ve also seen emerging trends in robotics lead by Willow Garage and their work with amazing research robots and operating software (ROS). Similar developments in synthetic biology are led by MIT’s [...]
[...] and to Willow Garage for what must be a very satisfying validation of their efforts. [SingularityHub via HoustonChronicle] Comments RSS [...]
[...] and to Willow Garage for what must be a very satisfying validation of their efforts. [SingularityHub via HoustonChronicle] Comments RSS [...]
[...] PR2 research robot. You can find all its specs and accomplishments in our previous coverage here, here, and here. Willow Garage is also the driving force behind the vast libraries of advanced algorithms [...]
[...] a real-life Rosie the Robot from the Jetsons. Just a few months ago we covered how it could fold towels with 100% accuracy and now it’s picking up trash. The rapid progress is made possible by Willow Garage’s [...]
Aaron says in the above article that a humanoid robot probably wouldn’t be used to fold towels because a dedicated towel folding machine could do the job faster – however, it is the fact that it is an android which is its strength, because the same bot can also fetch you a beer or play pool too, without needing dedicated bots for those tasks as well. This is the first demonstraion I have seen anywhere for a bot actually performing a useful task. I cant wait till someone programs this to deal with t-shirts and pants, stuff washing in the machine and hang it up too!
[...] at UC Berkeley used Willow Garage’s PR2 robot to fold towels. The UCB programming used some innovative visual scanning techniques, allowing the PR2 to pick up a [...]
[...] the University of Berkeley already demonstrated the PR2’s knack for housework by getting the robot to fold towels perfectly. For the video contest, however, they upgraded the towel folding to include input via Twitter. [...]