Advertisers already pay big bucks for information about your search habits, your emails, and your tweets. In the near future they may be listening in on your conversations with your friends as well. theGOOD, a Portland based interactive think tank, has developed a prototype program for eavesdropping on a discussion and pulling out the important opinions. Called Centamental, this proof of concept platform translates casual remarks you make, say in a store, into valuable data that companies can use to understand how average people feel about their products. I talked with theGOOD co-founder Chris Teso and CTO Shaun Tinney about the potential and the obvious concerns that surround an eavesdropping program bent on understanding how we feel. Watch their commercial for the project in the video below. Many corporations claim to care what you really think…now they have a chance to know for sure.
What exactly will Centamental do? Give the program some audio – either from a hidden microphone, or a recording from a phone conversation, an old movie, etc – and it strips out all the pertinent data about how people feel about things. So, if you said, “I love cheeseburgers from this local burger shack. Big chain burgers aren’t nearly as good.” Then Centamental would spew out something like “+cheese +burgers +cheeseburgers +local food -big chain restaurants”. Where the ‘+’ and ‘-‘ marks (Centamental actually uses hearts and other symbols) indicate positive and negative opinions. The identifiable info about the speaker is tossed aside, only the sentiment remains. Give Centamental enough audio from enough places and you’d get a better idea of how people felt about…well, nearly anything.
When I first heard about Centamental I thought it was too stereotypically Big Brother to be true. Yet speaking with Teso and Tinney made me quickly realize two things: 1) Analyzing public remarks for sentiments about corporate products is already well entrenched in our emergent internet culture. 2) The development of a technology like Centamental was guaranteed to happen sometime.
Companies are already analyzing our online activities to better market products to us. Gmail anonymously sifts through your writing, and nearly all search engines do the same. Now, businesses are looking to twitter feeds to understand public sentiment. TwitterSentiment and TweetFeel sift through thousands (if not millions) of public comments on Twitter and gather the positive and negative opinions about a topic. The mining of the tweetsphere for data is already well established.
Centamental is very similar to these online products, only it uses real world audio. From a technical point of view, however, this isn’t that big of a change. Speech to text technology easily converts audio into text. From there you just sift through large piles of text comments looking for positive, negative, or neutral remarks about things you care about.
In fact, the technology behind Centamental was almost begging to be put together. Teso and Tinney explain that the proof of concept product up on the Centamental site is actually more of a hack at this point than a new creation. They use Ribbit to collect audio, this gets sent to a Google Voice number which converts speech to text, which is then emailed to an address where several APIs are applied that strip out the important data. From collection to sentiment takes around 30 seconds. It sounds pretty simple, but Teso thinks that, given enough audio from the right places, even this basic prototype would be able to answer complex questions like “What do people in the Pacific Northwest think about battery life for the iPhone?”
theGOOD has made a habit of innovating on growing trends in the marketplace. They created sellsimp.ly a photo-based market (think Craigslist meets flickr), and theGOOD.uploadr (which makes uploading photos to flickr easier, especially when dealing with meta-data). Centamental, however, is the first that’s pulled them into the national spotlight.
According to Teso, Centamental’s already garnered the attention of half a dozen brands looking to possibly use the new technology. The next step in development would be to improve the analysis process so that Centamental can handle real world language. Sarcasm, slang, and stuttering – the sentiment analysis program of the future will need to handle them all.
Where might we see Centamental in the future? Potentially everywhere, and that’s the obvious privacy concern. Stores could mic their aisles, collecting data about what customers thought about products as they looked at them. Anyone could use directional microphones to record conversations in public places (bus stops, parks, stadiums) to get a better understanding of what ‘people on the street’ felt. In fact, anywhere you could collect audio you could collect sentiment.
I don’t think we’ll see this kind of technology spread so far so soon, however. The low hanging fruit is customer service hotlines. Most already warn you that “your call may be recorded for training purposes”. Many people are calling to complain or request help – they want their sentiments to be noticed.
Teso, who describes himself as a ‘hardcore libertarian’, seemed to think that even the larger ‘listening to conversations in public spaces’ application would be a net benefit for customers. Commenters would be both anonymous and oblivious, which is something that focus groups and satisfaction surveys simply can’t offer. Companies would be able to get information directly from consumers. Centamental’s style of analysis would be unique – and could possibly serve as a means to gather opinions that would otherwise be unheard.
Of course, there are reasons why many of us don’t take our private conversations and post them to company websites. Even with identifiable data stripped out, there’s something very eerie about people collecting information on what you are saying. The potential for abuse, either from governments or businesses, seems very great. But it’s the widespread collection of audio without people’s consent that is really threatening. Sifting through such recordings for anonymous sentimental analysis is one of the milder possible applications.
In any case, Centamental may seem ominous at first glance, but it’s also too ingenious not to be applied. Data mining is becoming something of a social science, and its demand is increasing as companies fight to market to customers successfully. Translating real world conversations into statistics that businesses could act on is a seductive possibility. Centamental may still be in the prototype phase, but I guarantee you that we’ll see technology like this in use soon. Or, really, I guess we won’t ‘see’ it at all.
[image credits: Centamental]
[source: Chris Teso, Shaun Tinney, Centamental, theGOOD]
