#1 Watson Smart Enough to Learn Bad Language
Posted: Thu Jan 10, 2013 12:29 am
Computer systems are now smart enough to diagnose illnesses, beat humans in word games, and now, they're smart enough to call people on their bullshit.El Reg wrote:IBM's Watson supercomputer was smart enough to beat two human opponents on US quiz show Jeopardy!, but there is apparently some knowledge that the system is still too immature to handle – namely, the contents of the Urban Dictionary.
Watson is perhaps the most sophisticated artificial intelligence computer system developed to date. In addition to its quiz-show triumph, it has already been put to work on a variety of real-world business scenarios, including analyzing customer data for the finance industry and helping doctors diagnose and treat patients.
Part of what makes Watson's problem-solving ability seem so uncanny is its advanced natural language processing capabilities, which allow it to understand the complexities of unstructured data. But as Fortune reports, IBM researcher Eric Brown learned that there are limits to how well Watson can interpret human communication.
In an effort to broaden the range of texts that Watson could interpret, Brown tried teaching it the Urban Dictionary, that crowdsourced compendium of words that tend to totter on the bleeding edge of modern English speech. WCGW?
Brown soon found that while Watson is fast with facts, it's none too quick to pick up on the subtleties of slang. Worse, like any schoolchild, the 6-year-old Watson was all too eager to try out the new words it had learned.
Almost immediately, Watson began casually dropping profanity into its everyday speech, such as answering one researcher's query with the less-than-scientific term "bullshit." (Although, to be fair, Watson may be sharper than the IBMers care to admit – just not particularly tactful.)
In the end, Brown and his team had to develop a filter to restrain Watson's more Tourette's-like impulses while they worked to undo the corruption that the introduction of the Urban Dictionary had caused.
Fortunately, Watson's current applications on Wall Street and in hospitals don't generally require it to know the difference between a ROFL and a WCETHBAC. But the incident does help to illustrate the fact that, as advanced as Watson may be, science is still a long way from developing a computer that can communicate as fully and richly as humans can.
"As humans, we don't realize just how ambiguous our communication is," Brown says, noting that Watson picked up a few bad habits from reading Wikipedia, too.
I for one fucking welcome our new motherfucking computer fucking overlords.
