Wednesday, January 13, 2021

"systems couldn’t tell when words in a sentence were jumbled up"

From the MIT Technology Review, we find that while Artificial Intelligence (AI) continues to make strides, it also contains a significant flaw.

"Many AIs that appear to understand language and that score better than humans on a common set of comprehension tasks don’t notice when the words in a sentence are jumbled up, which shows that they don’t really understand language at all. The problem lies in the way natural-language processing (NLP) systems are trained; it also points to a way to make them better.

Researchers at Auburn University in Alabama and Adobe Research discovered the flaw when they tried to get an NLP system to generate explanations for its behavior, such as why it claimed different sentences meant the same thing. When they tested their approach, they realized that shuffling words in a sentence made no difference to the explanations. “This is a general problem to all NLP models,” says Anh Nguyen at Auburn University, who led the work."

Continue reading the article online (subscription may be required)

 

From the MIT Technology Review, we find that Artificial Intelligence (AI) contains a significant flaw
From the MIT Technology Review, we find that Artificial Intelligence (AI) contains a significant flaw


No comments:

Post a Comment