Print 24 comment(s) - last by agon.. on Jul 23 at 8:36 AM

Enduring an IQ test for children showed that it lacked commonsense

An artificial intelligence system proved to have the intellect of a four-year-old after undergoing tests specialized for young children. 

Researchers from the University of Illinois at Chicago -- led by Robert Sloan, professor and head of computer science at UIC -- put MIT artificial intelligence unit ConceptNet 4 to the test and found its scores to be very revealing about the strong and weak spots of AI today.

ConceptNet 4 was given the Weschsler Preschool and Primary Scale of Intelligence Test, which is an IQ test for youngsters. The results showed that ConceptNet 4 had the IQ of a four-year-old. 

More specifically, ConceptNet 4 had very uneven scores across the board, which would typically concern those who administer the test. The AI system did well on vocabulary tests and the ability to recognize similarities, but lacked when it came to "why" -- or commonsense -- questions. 

The team concluded that commonsense is where AI researchers need to focus. For instance, ConceptNet 4 may know a fact about something, but doesn't have commonsense to know what it feels like or how it will react in certain situations. 

"All of us know a huge number of things," said Sloan. "As babies, we crawled around and yanked on things and learned that things fall. We yanked on other things and learned that dogs and cats don't appreciate having their tails pulled.

"We're still very far from programs with commonsense-AI that can answer comprehension questions with the skill of a child of 8."

This study will be presented July 17 at the U.S. Artificial Intelligence Conference in Bellevue, Washington. 

Source: Science Daily

Comments     Threshold

This article is over a month old, voting and posting comments is disabled

Common sense indeed
By karimtemple on 7/16/2013 9:24:54 AM , Rating: 2
The AI system did well on vocabulary tests and the ability to recognize similarities, but lacked when it came to "why" -- or commonsense -- questions.

The team concluded that commonsense is where AI researchers need to focus.
I refuse to believe they were surprised, or had to do all this to know that, lol. I refuse.

RE: Common sense indeed
By zephyrprime on 7/16/2013 9:57:38 AM , Rating: 2
Indeed. It's quite obvious. Especially for the people who developed the AI's to begin with.

RE: Common sense indeed
By othercents on 7/16/2013 10:06:30 AM , Rating: 2
The difference is the learning process vs the programing process. You can program in responses like vocabulary, however it will be difficult to programing learned responses. You really have to overwhelm the system with an absorbent amount of data for it to determine the best response.

RE: Common sense indeed
By Mitch101 on 7/16/2013 10:50:23 AM , Rating: 5
Its probably tough to program.

Its time for your data computer.
Come on now heres some data
I have a data airplane brum brum brum zoom open the hanger or the data airplane is going to crash.

RE: Common sense indeed
By karimtemple on 7/16/2013 11:02:38 AM , Rating: 2

RE: Common sense indeed
By UnauthorisedAccess on 7/16/2013 8:08:01 PM , Rating: 2
...I wonder if the virus/malware protection is better than the 4 year old "haven't washed hands in 12 hours, put entire hand in mouth while eating chips" bacterial awesomeness.

RE: Common sense indeed
By deltaend on 7/17/2013 1:27:09 PM , Rating: 3
Would be interesting if AI would develop a learning anti-virus system similar to an immune system. With the development of self-writing code in an AI program structure may also come new and much more indirect methods of infection such as mis-information, social AI engineering, and carefully planned/scripted events. A true AI would have to develop the ability of discernment to be able to tell what is true and what is false since a modern computer simply accepts all information given to it as true and accurate unless that information is cross-checked against other systems. Eventually, an AI would need to halt all programming interface from traditional methods and assume that all future code would need to be self-generated or risk conflicting code and contamination of it's system.

RE: Common sense indeed
By Director12 on 7/16/2013 5:45:22 PM , Rating: 4
Politicians of the west be warned, your jobs are now under threat.

RE: Common sense indeed
By Alexvrb on 7/16/2013 10:42:50 PM , Rating: 3
Don't be ridiculous, there's no way an AI can be programmed with the level of sleaze and corruption required to get into office. Not to mention it wouldn't know how to lie and get caught but still get away with it by colluding with the press/media.

RE: Common sense indeed
By Director12 on 7/17/2013 3:11:11 AM , Rating: 2
Hey, it's early days yet, don't give up hope.

By SublimeSimplicity on 7/16/2013 9:22:46 AM , Rating: 2
...the AI of the future will be very smart (pattern matching), fluent (excellent vocabulary skills) sociopaths (no common sense or emotion).

Maybe Science fiction has had it right years.

By marvdmartian on 7/16/2013 11:56:39 AM , Rating: 2
Have you ever taken care of a 4 year old? They're really good at throwing temper tantrums. Can you imagine an AI computer havine one of those??

They should have given it the intelligence of a 40 year old man. Then all it would be interested in is drinking beer and eating pizza, while holding in its gut to impress the cute female computers!

By Monkey's Uncle on 7/17/2013 8:35:43 AM , Rating: 2
Have you ever taken care of a 4 year old? They're really good at throwing temper tantrums. Can you imagine an AI computer havine one of those??

I have one word for that -- Skynet .

By Flunk on 7/16/2013 9:47:03 AM , Rating: 4
I think the people who wrote this original story don't have a very good grasp of what AI is. Yes, someone has written an AI agent that can perform on par with a 4-year-old on a specific test but that doesn't mean that it will perform similarly in any other circumstance. That implies that this team has created a "strong AI" which is a hypothetical type of AI with the ability to execute general tasks on par or better than a human and that is simply not the case here. This AI was designed for one purpose and isn't as revolutionary as the authors of the news article seem to believe.

Yes, it's cool. But it's not very practical and not beyond what others have done in AI recently.

RE: Deterministic
By Schrag4 on 7/16/2013 12:09:06 PM , Rating: 2
I agree. It may depend on how you interpret the A in AI, but to me if it's deterministic then it's not AI. Some argue that as long as you can't tell that it's deterministic then it's good enough, "perception is reality."

By Ammohunt on 7/16/2013 11:53:47 AM , Rating: 5
The AI system did well on vocabulary tests and the ability to recognize similarities, but lacked when it came to "why" -- or commonsense -- questions.

Just like most college graduates with a liberal arts degrees...Fascinating.

By Strunf on 7/17/2013 5:56:26 AM , Rating: 3
There's not a single bit of intelligence on these AI stuff, intelligence implies thought and reasoning, as long as these AI do not ask back questions and take lessons from our answers they have 0 intelligence.

RE: Intellegence
By mr.mac52 on 7/17/2013 3:14:53 PM , Rating: 2
AI is defined as artificial ignorance in my book.

By GulWestfale on 7/16/2013 9:11:39 AM , Rating: 1
you should make it president.

RE: cool
By StormyKnight on 7/16/2013 10:44:10 PM , Rating: 2
The AI system did well on vocabulary tests and the ability to recognize similarities, but lacked when it came to "why" -- or commonsense -- questions.

Too late. We already have Obama...

So in other words
By FITCamaro on 7/16/2013 10:51:16 AM , Rating: 2
It has the same level of mental development of many of today's youth.

Location Correct?
By drlumen on 7/16/2013 11:47:09 AM , Rating: 2
Are we sure this is in Chicago and not Urbana?

By arazok on 7/16/2013 1:01:20 PM , Rating: 2
You mean to tell me they have computers that are just as capable using common sense as Congress?!

Automate that shit!

By agon on 7/23/2013 8:36:37 AM , Rating: 2
Solaborate- New social networking and collaboration platform for technology professionals and companies. Experience it yourself by requesting a beta key at

"Nowadays, security guys break the Mac every single day. Every single day, they come out with a total exploit, your machine can be taken over totally. I dare anybody to do that once a month on the Windows machine." -- Bill Gates

Copyright 2016 DailyTech LLC. - RSS Feed | Advertise | About Us | Ethics | FAQ | Terms, Conditions & Privacy Information | Kristopher Kubicki