An interesting article on Science alert about a more complicated Turing test…
To find out just how advanced our current AI systems are, researchers have developed a tougher Turing Test – called the Winograd Schema Challenge – which measures how well robotic intelligence matches human intelligence.
In the end, the team found that – even though AI is definitely improving every day – our robotic pals are still seriously lacking some common sense, suggesting that it will be some time before AI is fully ready to meld with society.
First, before we go any further into the new competition’s results, it’s important to define what a ‘Turing Test‘ actually is. Developed and coined by Alan Turing back in the 1950s, the Turing Test is a way for researchers to challenge computer-based intelligence to see if it can become indistinguishable from human intelligence, which is basically the goal for AI researchers.
These tests are mostly language-based because human language is – when you truly think about it – super weird. In short, Turing believed that AI should aim to have robots that a human can talk to without knowing they are robots. As anyone who has ever screamed at Siri knows, this is a task much easier said than done.
Source: A tougher Turing Test shows chatbots are still pretty stupid – ScienceAlert