PaPeRo is the big-eyed bot that could help you love to communicate via telepresence.

When you’re a super cute blushing robot, humans will let you get away with murder. Especially if the thing you’re killing is dying a slow death anyway. NEC in Japan developed its Partner-type Personal Robot, or PaPeRo, as a communications platform for research into human-machine interactions. Now, they’re testing the lovable bot as a teleconferencing tool. In a series of experiments in office-like settings, NEC found that users preferred the diminutive device to typical conference phones. Able to recognize faces, respond to touch and speech, swivel its head, and wheel around, PaPeRo could make a very cool table-top telerobot. I certainly wouldn’t mind it replacing the landline at my office. Unfortunately, this case study probably won’t lead to any commercially available device in the near future as NEC is still in research. Still, I’m excited by PaPeRo showing off its telepresence talent because it’s another sign that the race to create personal robots is heating up.

NEC created PaPeRo to help them “investigate the relationships between people and robots.” Essentially that means they created it to be as adorable as it is helpful – it actually blushes when it gets loved. The subject of many case studies and demonstrations over the past half dozen or so years, PaPeRo has seen a variety of possible applications. It’s helped take care of children, greeted people to museums, and was recently tested in nursing homes as a combination companion/news delivery system. It seems to excel in interactions with humans because its talents are specifically geared towards the ways we communicate – facial expressions, eye contact, audio, and touch. You can get a taste of these capabilities in the video below, taken during one of its many conference appearances.

Most of the qualifications for good human-robot interactions apply to humans wanting to speak to other humans through a robot. Capable of being remotely controlled via an online interface, PaPeRo can perform the same movements (swiveling its head to look at a speaker) as you might if you were in the room yourself. Its big camera eyes give you a good sense of what’s happening around the room, while its responsive face can convey simple emotions to your colleagues.

I would think that most telerobots should actually have a display screen that shows the speaker’s face. Why use an elaborate robotic facial expression system when a small LCD monitor can do the same at a fraction of the cost? Optimally, one would hope that we could combine robot gestures and human faces to get the best out of both worlds, as we’ve seen before with MIT’s MeBot. Keep the blushes, the swiveling head and the little dancing body, add in the user’s real face, and you’ll have a system that humans can relate to on many levels. At least, that’s what I would do. Several other developers have gone with the robot only (no screen) approach to telepresence, and it may be there are applications where this will be preferable. Personally I think cold robot faces speaking with the voices of my friends would be creepy, but that might just be my cultural context. I know Japan has a different relationship with its bots.

If you’re waiting for PaPeRo to brighten your home or office phone conversations, don’t hold your breath. While NEC rents out PaPeRo units on a limited basis, there’s little indication that the bot will actually reach market anytime soon. That’s okay. All we really need is a plurality of robot companies investing in the personal robot paradigm, and we already have that. From complex and highly capable human-scale machines like Willow Garage’s PR2 to smaller fun-orientated ‘pets’ like Pleo, the industry clearly understands the importance of bringing a robot to market that humans can both rely upon and enjoy as a companion. With all of this background experience, it will hopefully only be a small matter of time before someone can cobble together enough working systems to create a personal robot that every one will want and be able to buy. I’m guessing that one of the killer applications for said mythical future personal robot will be telepresence. Take a good look at PaPeRo sitting on that conference table. The first successful personal robot of the future is probably going to be very similar, and doing much of the same work.

How will we celebrate when that bot finally arrives? I’ll probably spend the day blogging about it, but I’m guessing Japan will have a slightly less reserved reaction. I’ll leave you with a little PaPeRo video to demonstrate what I mean. It’s the perfect combination of cute and WTF. Don’t miss PaPeRo ‘interacting’ with the elderly around 2:00.

[image credits: NEC via Robonable]
[video credits: Hardwarezone.com, NEConlineTV]
[sources: Robonable, NEC (Jp and En)]

Will the iPhone be the Universal Translator of the future?

When watching Star Trek, I was always amazed that the aliens all spoke English. Writers explained this happy coincidence by the presence of a universal translator (UT), a portable device which could take any language and translate it into any other language as needed. Our nonfictional modern world has more than 20,000 different languages (if you include dialects) in its history. With the rise of globalization we desperately need an universal translator to help us speak to one another. Luckily, there are several different companies that are taking the first steps to creating an UT. Sahkr and Jibbigo have developed iPhone Apps which transform the smart phone into a handheld speech to speech translator. Check out some of their demo videos after the break.

Computer aided speech to speech translation isn’t easy. You need speech recognition, language analysis, machine translation, language generation, and speech synthesis. We’ve had limited handheld translators for some time. Devices like Voxtec‘s Phraselator allow you to select a range of sentences and have them translated into many different languages. We’ve also had more complex non-portable systems (like IBM’s MASTOR) which can do nearly full translation. But the products created by Sahkr and Jibbigo represent a new paradigm in speech to speech: commonly used hardware devices adapted solely through software. By integrating into an existing hardware platform, these next generation programs are taking us one step closer to having a universal translator that anyone can carry in their hands.

Sahkr is one of the premier English/Arabic translation companies in the field. The translation software, Arabic Language Buddy, went live in September and is now available for download on either the iPhone or BlackBerry. It is limited to conversions between English and Modern Standard Arabic (MSA), but it works amazingly well:

Sahkr takes great pride in the realistic synthetic voices used for their translation software. I don’t speak MSA but the flow and tone of the translation is much better than I would have expected. The company press release also claims that their translations are ranked #1 by the US government. Users can even adjust the text of their translation (via keypad) to better communicate their words precisely before it is spoken. As you can imagine, this high quality comes at a high price. The software is for lease only (which isn’t that unusual for premium smart phone Apps) and the first month is $10. Subsequent months, however, can cost you either $50 or $150, depending on whether or not you qualify as an academic user. That’s no small change for the average user, but for the international business traveler it likely falls within budget.

If you’re looking for a cheaper option, and you favor the iPhone over the BlackBerry, look no further than Jibbigo. Developed by Alex Waibel at Carnegie Mellon University, and released in October, Jibbigo does most everything that Shakr does, just in Spanish and only on the iPhone. You can edit via keypad, shake the iPhone to restart, and there’s even a back translation check. All that, and you make just one payment of $25.

The difference in price between the two applications may reflect a relative scarcity of Arabic to English translators, but I’m guessing it also has to do with Shakr’s higher status as a translation service. Jibbigo is a fairly new company with hopes of expanding from Spanish and English into other major languages. Recently however, they had to deal with an audio glitch in their first released version (it’s fixed with an update).

The tele-scouter projects texts and images directly into your peripheral vision and could easily be used as a speech to text translator.

Of course, a portable UT doesn’t have to fit in your hand. NEC’s Tele Scouter is a head mounted optical display which projects words and images into your peripheral vision. Engineers claim that the use of the peripheral allows you to wear Tele Scouter for hours without headaches or other discomfort. It is very light weight, and essentially looks like a small projector on a pair of glasses. A digital eyepiece reader is connected to a portable computer which interfaces with a remote server giving the user access to a local (or perhaps even global) network. Currently, NEC plans to market Tele Scouter as a means for engineering and technician teams to remotely share data and expertise in vivid detail. For a team of 30, the Tele Scouter system would cost around $8 million. NEC will launch in 2010 and hopes to sell 1000 such systems in three years.

A trimmed down version of Tele Scouter may be adapted to serve as a universal translator. With rapid access to a remote server, the eyepiece has much more resources at its disposal than a smart phone and could serve to provide closed captioning during a conversation, as well as an augmented reality experience. There has been some buzz that NEC plans on following that route.

Yet even if Tele Scouter stays a high-level engineering network tool, the concept behind a visual universal translator could be adapted into another system quite easily. Today, all it takes is a web browser and Google to translate text from one language to another. In fact, judging from our servers, many of you actively use Google to read this blog in a non-English language. It’s only a matter of time before someone combines a head mounted display, a mobile internet connection, and speech to text software to create a do-it-yourself UT.

If you’re looking to start one of those DIY projects, you should do so quickly. As Shakr and Jibbigo find success in their Apps, we’re likely to see similar products spring up for many more languages. Eventually smart phones will become powerful enough to support translators that can identify and convert anything they hear. Many of the technologies we review on Singularity Hub are expected to take many years or even decades before they come to full fruition. Speech to speech hand held devices, however, are already here. Universal translators may appear much sooner than anyone believed possible. So get excited, Star Trek fans, the 23rd century is arriving early.

[photo credits: Shakr, NEC]
[video credits: Shakr, Jibbigo]