Exclusive: I Used BlindType, Virtual Keyboard of the Future

5 84 Loading
blindtype-virtual-keyboard

Type however sloppily you want. BlindType knows what you mean to say.

Typing on the iPhone is like squeezing sausages into a soda can – you can get it to work, but it’s not pretty. BlindType is changing that. The startup has created a new touchscreen keyboard program of the same name that changes size, orientation, and position to match your wandering fingers as they type. BlindType also features some of the most impressive typing correction software I’ve ever seen. The result is a practical touchscreen interface that knows what you meant to type, even if you make mistakes. Lots of them. In fact, you can type without looking at the screen at all! It’s amazing, and I got to see it in person when I visited with BlindType creators Kostas Eleftheriou and Panos Petropoulos in San Francisco. Check out their demonstration video below. It’s hard to believe that they developed this software in less than one year.


Because BlindType is still under development Kostas and Panos would only let me take still shots of the program. Yet as you can see in their public demo video, BlindType lets the user be sloppy. When I tried the program on an iPad I could relax about mistakes. Not in spelling, but in the actual way I actually tried to hit keys on the touchscreen keyboard. Do you have fat fingers like me? Not a problem. Do your hands migrate slowly as you type? It can handle that too. Hold your iPad to one side, type in progressively larger or smaller movements, even ditch the keyboard altogether. BlindType can deal with it all.  Just watch and learn:

If you found the above demonstration for BlindType impressive, you’re not alone. The video received more than 300,000 hits in its first week. Those are great numbers for a tech demo from a startup on YouTube. Kostas and Panos were so impressed with the positive response they even created a follow up thank you video:

Why all the hullabaloo? BlindType is easing one of the biggest fears people have about touchscreen interfaces: they don’t trust a keyboard without feedback. BlindType doesn’t let you feel the letters but it does give you a lot of confidence in your typing. Kostas and Panos wanted a system that assumed the typist knew what they were doing. If you type one letter on the right, another on the left, and you don’t directly hit the keys, BlindType tries to figure out what you meant to hit. Sometimes it can surprise you. Kostas and Panos dared me to see how poorly I could type and still have the right word appear. I typed without really looking at the keyboard and entered something like “ubvunvryjankt”. BlindType knew I meant “inconceivable”. I was amazed. Kostas and Panos laughed, they get that all the time.

That’s when I really felt challenged and I tried my absolute damnedest to defeat BlindType. I’m glad I did. I learned how robust the system is. We turned off the keyboard. It didn’t appear on the iPad screen at all. I typed in different directions, different speeds, and randomly changed the space I put between the letters I was trying to type. BlindType handled it all with relative ease. When I entered in new words the program didn’t know (like my last name), a little menu popped up letting me store them in a custom dictionary with just one touch. Easy.

Of course it’s not perfect. As Kostas and Panos helped me see, the program has limitations. BlindType is a typing correcter, not a spelling correcter. If you mistype a word by adding or subtracting a lot of letters, it doesn’t work well. It comes with a spell-checker/auto-correction feature (or it will) but don’t expect it to perform wonders on both typing and spelling simultaneously. It’s good, but there’s only so much decoding that’s mathematically possible.

There’s also limitations on the physical side of things. You have the choice of leaving the spacebar enabled or disabled. If you enable it, then there’s a fixed point on an otherwise unfixed keyboard. That means you have to actually hit the spacebar button where it’s supposed to be – that’s not always easy if you’re typing sloppily. If you disable the spacebar then spaces are inputed by swiping left to right. That’s a reasonable adaptation to ask of a user, but it takes a little getting used to.

And Kostas and Panos are still working out how to get the program to differentiate between very fast typing and swiping. So if you type as fast as you possibly can sometimes the program thinks that two letters next to each other was actually you trying to make a swiping motion. Same with resting your fingers on the touchscreen – right now the program thinks you are trying to make a long swipe. Panos said they could solve that pretty easily in the future.

More limitations? Sure: if you have to swipe left to right, then as you rotate the phone (or iPad) you have to be careful about what direction it considers left to right. There’s a little arrow to help you keep track of this, and the program reorientates itself after every new word, but you can, if you’re nasty, confuse BlindType by typing things upside down or backwards (I told you I felt challenged). Most users aren’t going to intentionally try to cause a failure though, so this is a very minor limitation.

All in all, I was simply blown away by how BlindType transformed me from a timid typist into a bold keyboard-challenging beast. I was so confident in the program’s skills (in just a few minutes of using it!) that I was typing super sloppy and expecting the best. And I got it the vast majority of the time.

With the product being so sound, I was naturally interested in how it worked, and how they developed it. That’s when Kostas and Panos got very tight-lipped. They’ve received so much attention, from apparently some big name people, that they can’t discuss anything. They won’t even generally describe how BlindType approaches the problem. I guessed it was analyzing the relative position between finger taps and they just gave me their best poker faces. No revelations at all. Kostas did allude to the fact that this is an AI project…but not much was said beyond that.

blindtype-kostas-panos

Panos Petropoulos and Kostas Eleftheriou are cousins from Greece. They conceived and created BlindType in less than a year. What have you been up to recently?

And BlindType is a small company, so there’s little chance that the secrets will leak out. In fact, BlindType really just has two employees: Kostas and Panos – cousins from Greece. Though they’ve had help with testing and such, the two of them essentially developed this program on their own. That floored me. How long did it take them to create it? A few months! Though Panos admitted they have been thinking about it “for about a year.”

Just as they are reluctant to discuss the specifics of BlindType’s inner workings, Kostas and Panos are not giving details about their funding or ongoing agreements with manufacturers. Will it be installed on the manufacturing side or the consumer side (like an App)? No comment. If it is consumer-side, will it be free, $1, or $25? No comment. The only real answer I got from them is when I asked them if they had enough money to fund the rest of the program’s development. They gave me enigmatic smiles and said, “oh, we’ve got no worries.”

Clearly they think BlindType is going to be big. Will it succeed? Well, users are attracted to the promise of a better system, that much is clear. Touchscreen keyboards and predictive text algorithms are also a big business. Currently there are hundreds of millions of touchscreen devices sold each year and those numbers only look to rise as slate computers like the iPad gain ground. Nearly every single one of these machines needs a virtual keyboard and associated auto-correction software. When I asked Kostas and Panos which devices they were looking to port BlindType to, they simply said “all of them.” Or at least as many as they could. Their goal, which is also stated on their website, “is to become the largest player in the industry.” The potential rewards of that industry are large. Back in 1999, the T9 predictive type software sold for $350 million in stock to AOL, though it was sold again in 2007 for just $269 M.

In the short term, BlindType is going to focus on mobile touchscreens. The program runs on iPad and iPhone and will be running on Android phones soon. That’s millions of units right there. But Kostas and Panos talked about it eventually being used on all kinds of touchscreens, from new PC desktops to street kiosks. And what about phones with little plastic keyboards like the Blackberry? BlindType could easily be adapted to improve accuracy there too. In fact, chances are that BlindType could be used in just about every keyboard (virtual or physical) there is. Think about that. This is a huge product.

It’s probably coming to you soon. While they won’t reveal specifics about product launch, Kostas and Panos said that beta testing will happen soon. Working with the product as I did, it seemed really close to ready. Kostas said that it takes about 150 milliseconds for BlindType to process each word, and the industry standard is 200 ms, so that’s a good sign this product is good to go. As BlindType makes more announcements about it’s progress, we’ll keep you up to date.

And what does all of this have to do with the Singularity and accelerating technology? Artificial intelligence is analyzing flawed human output and predicting what the person ‘really meant’. There’s a lot of potential there. BlindType is a narrow application, but as AI gets better at interpreting human input, it will let us use machines more naturally. Right now we’re worried about virtual keyboards, but think about brain computer interfaces. Computers won’t just have to decode sloppy typing, they’ll have to decode sloppy thoughts. Programs like BlindType are only the beginning. As machines and humans become more interconnected, we’ll need more ingenious ways of building confidence in those connections. Kostas and Panos may have solved virtual keyboard problems in a few months. Let’s hope our future user interfaces will be able to be improved as quickly.

[image credits: Aaron Saenz/Singularity Hub]

[source: BlindType]

Discussion — 84 Responses

  • Sumatra July 30, 2010 on 5:32 am

    There’s not much to say. Pretty impressive. I don’t know how it works, but I am glad it works. But, there is a little discomfort here. What about those whose primary language is not English? (-:

    • R. K. Murphy Sumatra July 30, 2010 on 5:46 pm

      The way it works seems pretty straightforward. It looks at the delta between the presses and tries to map them to the deltas between keyboard keys, as well as some heuristics to try to determine which word you actually meant to type. Being able to do that isn’t that impressive. What is impressive however is that they managed to do it fast and on the limited hardware of an iPad/iPhone. I do wonder how good the software works on less common words. I know just from using the built in auto-correction on the iPhone it often thinks I mean one word when I mean another, and with something like this that would only get worse.

      • oObsi R. K. Murphy July 31, 2010 on 6:35 pm

        In the case of BlindType it looks like you can pick a word, a feature thats lacking on the iPhone.
        One of those features where I don’t understand its absence, especially because of the problem you just stated.

  • Sumatra July 30, 2010 on 1:32 am

    There’s not much to say. Pretty impressive. I don’t know how it works, but I am glad it works. But, there is a little discomfort here. What about those whose primary language is not English? (-:

    • Aaron Saenz Sumatra July 30, 2010 on 1:40 am

      Well, BlindType can be ported over to pretty much any other keyboard format besides Qwerty. So no matter what language you’re used to, BlindType is likely to be helpful.

    • R. K. Murphy Sumatra July 30, 2010 on 1:46 pm

      The way it works seems pretty straightforward. It looks at the delta between the presses and tries to map them to the deltas between keyboard keys, as well as some heuristics to try to determine which word you actually meant to type. Being able to do that isn’t that impressive. What is impressive however is that they managed to do it fast and on the limited hardware of an iPad/iPhone. I do wonder how good the software works on less common words. I know just from using the built in auto-correction on the iPhone it often thinks I mean one word when I mean another, and with something like this that would only get worse.

      • oObsi R. K. Murphy July 31, 2010 on 2:35 pm

        In the case of BlindType it looks like you can pick a word, a feature thats lacking on the iPhone.
        One of those features where I don’t understand its absence, especially because of the problem you just stated.

  • Jeremy July 30, 2010 on 2:01 pm

    I hope they don’t take too long porting it over to desktops. Multitouches need something like this, as simulating a traditional keyboard on them feels awkward and looks

    • Jeremy Jeremy July 30, 2010 on 2:05 pm

      Oops, sorry. You can delete this one.

  • Jeremy July 30, 2010 on 10:01 am

    I hope they don’t take too long porting it over to desktops. Multitouches need something like this, as simulating a traditional keyboard on them feels awkward and looks

    • Jeremy Jeremy July 30, 2010 on 10:05 am

      Oops, sorry. You can delete this one.

  • Jeremy July 30, 2010 on 2:02 pm

    I hope they don’t take too long porting it over to desktops. Multitouches need something like this, as simulating a traditional keyboard on them feels awkward and looks anachronistic

  • Jeremy July 30, 2010 on 10:02 am

    I hope they don’t take too long porting it over to desktops. Multitouches need something like this, as simulating a traditional keyboard on them feels awkward and looks anachronistic

  • krunkster July 30, 2010 on 2:28 pm

    I think the AI behind this technology is the only real value here. Typing could be obsoleted for touch screens once more developers start exploring non-traditional input methods for touch screen devices.
    Look at “Swype” to see one way of of replacing typing. I’ve had a chance to use it, and it takes some getting used to, be after a while seems vastly superior to typing on a touchscreen.

  • krunkster July 30, 2010 on 10:28 am

    I think the AI behind this technology is the only real value here. Typing could be obsoleted for touch screens once more developers start exploring non-traditional input methods for touch screen devices.
    Look at “Swype” to see one way of of replacing typing. I’ve had a chance to use it, and it takes some getting used to, be after a while seems vastly superior to typing on a touchscreen.

  • rrrrrichard July 30, 2010 on 4:34 pm

    Well, there goes the type-one-to-the-right password trick.

  • rrrrrichard July 30, 2010 on 12:34 pm

    Well, there goes the type-one-to-the-right password trick.

  • Frank MacGill July 30, 2010 on 4:45 pm

    This irresponsible software is teaching the younger generation that accuracy doesn’t matter. It used to matter.

    • Matthew Carlson Frank MacGill July 30, 2010 on 6:19 pm

      You’re so full of crap it’s making me sick. Go churn some butter.

    • wbarrows Frank MacGill July 31, 2010 on 3:05 am

      You are missing the point.. Computers should adapt to us, not the other way around. I am a reasonably competent typist, yet on my iPod, I have to slow to a crawl. This is due to limited design not skill or accuracy. BlindType could be exactly what I need.

      • Dave wbarrows July 31, 2010 on 3:49 am

        Agreed, but that means younger people should not have values like precision or accuracy? Sorry, I don’t see those as being old-fashioned values.

        • wbarrows Dave July 31, 2010 on 5:18 am

          non-sequitur. I said nothing about values or fashion.

  • Frank MacGill July 30, 2010 on 12:45 pm

    This irresponsible software is teaching the younger generation that accuracy doesn’t matter. It used to matter.

    • Matthew Carlson Frank MacGill July 30, 2010 on 2:19 pm

      You’re so full of crap it’s making me sick. Go churn some butter.

    • wbarrows Frank MacGill July 30, 2010 on 11:05 pm

      You are missing the point.. Computers should adapt to us, not the other way around. I am a reasonably competent typist, yet on my iPod, I have to slow to a crawl. This is due to limited design not skill or accuracy. BlindType could be exactly what I need.

      • Dave wbarrows July 30, 2010 on 11:49 pm

        Agreed, but that means younger people should not have values like precision or accuracy? Sorry, I don’t see those as being old-fashioned values.

        • wbarrows Dave July 31, 2010 on 1:18 am

          non-sequitur. I said nothing about values or fashion.

  • TimB July 30, 2010 on 4:58 pm

    Pretty cool, good luck getting it into the App Store though. It “…duplicates functionality or a feature of an existing Apple application…” and hence violates the Apple Developer agreement. Despite how good it may be, nobody can develop something better than Apple according to Uncle Steve.

    • Darryl TimB August 2, 2010 on 9:30 pm

      I wonder where they are getting their funding??? Could it be …..

  • TimB July 30, 2010 on 12:58 pm

    Pretty cool, good luck getting it into the App Store though. It “…duplicates functionality or a feature of an existing Apple application…” and hence violates the Apple Developer agreement. Despite how good it may be, nobody can develop something better than Apple according to Uncle Steve.

    • Darryl TimB August 2, 2010 on 5:30 pm

      I wonder where they are getting their funding??? Could it be …..

  • Chris Dennett July 30, 2010 on 5:01 pm

    Apple need to buy this company and integrate their technology :3

  • Chris Dennett July 30, 2010 on 1:01 pm

    Apple need to buy this company and integrate their technology :3

  • RO July 30, 2010 on 1:08 pm

    Hoping both will be supported…

    • RO RO July 30, 2010 on 1:10 pm

      Dvorak? Linux?
      Meant those as a “subject”, not website.
      Guess I could use some typing help ;-]

  • RO July 30, 2010 on 5:10 pm

    Dvorak? Linux?
    Meant those as a “subject”, not website.
    Guess I could use some typing help ;-]

  • InteractiveLogic July 30, 2010 on 8:03 pm

    wow… I just posted this tweet two days ago: http://tinyurl.com/2c4nvao — Amazing! Nice to see we’re on the same page, but your solution is on steroids! ;)

  • InteractiveLogic July 30, 2010 on 4:03 pm

    wow… I just posted this tweet two days ago: http://tinyurl.com/2c4nvao — Amazing! Nice to see we’re on the same page, but your solution is on steroids! ;)

  • Dave July 30, 2010 on 8:14 pm

    Apple had better bloody not buy this company and integrate the technology. They’ve damned well got enough. Keep it free (i.e. unencumbered by big corps) and sling it over to my Android phone ASAP.
    I wouldn’t pay for a lot of apps but I’d pay for this.
    Awesome.

  • Dave July 30, 2010 on 4:14 pm

    Apple had better bloody not buy this company and integrate the technology. They’ve damned well got enough. Keep it free (i.e. unencumbered by big corps) and sling it over to my Android phone ASAP.
    I wouldn’t pay for a lot of apps but I’d pay for this.
    Awesome.

  • Andrew Ducker July 30, 2010 on 9:27 pm

    Have you taken a look at Swype?

    Seems to be almost as tolerant, but faster to move your fingers over, because you’re not having to raise and lower it.

  • Andrew Ducker July 30, 2010 on 5:27 pm

    Have you taken a look at Swype?

    Seems to be almost as tolerant, but faster to move your fingers over, because you’re not having to raise and lower it.

  • Joe The User July 31, 2010 on 7:27 am

    Looks like a brilliant adaptive piece of work.

    Things like this, programs that adaptively extract the maximum information from the minimum user input, are going to be the future of interfaces.

    It is tragic that this and things like are also likely going to be tied up in patents and secret algorithms.

    Microsoft and Apple have showed how profitable owning the interface is and also exploitative the owners can be.

  • Joe The User July 31, 2010 on 3:27 am

    Looks like a brilliant adaptive piece of work.

    Things like this, programs that adaptively extract the maximum information from the minimum user input, are going to be the future of interfaces.

    It is tragic that this and things like are also likely going to be tied up in patents and secret algorithms.

    Microsoft and Apple have showed how profitable owning the interface is and also exploitative the owners can be.

  • Hm August 2, 2010 on 12:14 am

    Give them 20 minutes or so and Apple will have these guys and their tech bought and integrated.

  • Hm August 1, 2010 on 8:14 pm

    Give them 20 minutes or so and Apple will have these guys and their tech bought and integrated.

  • CKofAZ August 2, 2010 on 6:28 pm

    Im just happy that I have to scroll this far down to get to the end of the comment section. Its good to see “The Hub” getting some conversation going.

  • CKofAZ August 2, 2010 on 2:28 pm

    Im just happy that I have to scroll this far down to get to the end of the comment section. Its good to see “The Hub” getting some conversation going.

  • Jonathan August 2, 2010 on 7:02 pm

    I hope there is a beta release or something. That would be nice. I would like to see how well it functions! Looking forward to it!

  • Jonathan August 2, 2010 on 3:02 pm

    I hope there is a beta release or something. That would be nice. I would like to see how well it functions! Looking forward to it!

  • John Mc August 2, 2010 on 10:15 pm

    So how long until Apple just buys them out…

  • John Mc August 2, 2010 on 6:15 pm

    So how long until Apple just buys them out…

  • Ben Bradley August 2, 2010 on 10:24 pm

    I’ll give you my Model M when you take it from my cold dead hands! Besides, my fingers are too dirty, grungy and greasy to touch the screen.

    Ben “Space Saver” Bradley

  • Ben Bradley August 2, 2010 on 6:24 pm

    I’ll give you my Model M when you take it from my cold dead hands! Besides, my fingers are too dirty, grungy and greasy to touch the screen.

    Ben “Space Saver” Bradley

  • Bryan Long August 3, 2010 on 2:44 am

    Of course, it will work best for someone who is a relatively proficient typist who knows where the keys are. As more people become dependent on predictive typing, their positioning will become more random. The next generation of predictive typing after this will learn to profile an individual, and each individual will diverge into a private “idiom” of finger movements for particular words.

  • Bryan Long August 2, 2010 on 10:44 pm

    Of course, it will work best for someone who is a relatively proficient typist who knows where the keys are. As more people become dependent on predictive typing, their positioning will become more random. The next generation of predictive typing after this will learn to profile an individual, and each individual will diverge into a private “idiom” of finger movements for particular words.

  • dualcow October 10, 2010 on 2:50 am

    Thanks for this very interesting and informative hub.. Keep up the good work!