Nope, there’s nothing wrong with the test. It wasn’t designed to test if it was “strong AI” or anything like that, it was designed to answer the question “Can machines think?” and at this point, the clear answer is yes they can.
Are they perfect? No. Can you trip them up? Yes.
Are both of those previous answers also true for humans? Yes.
There’s plenty of humans that would struggle with counting the number of “r” in Strawberry, and most models are well past that level of failure. The current ones even recommend you drive to the car wash even if it’s only 50 feet down the road.
I’m not so sure that he would. The whole thing is rather moot though because thinking isn’t a yes or no question.
A fun quote I heard previously, was from someone involved in making bear proof garbage bins stating that there were challenges because there’s a significant overlap between the dumbest humans and the smartest bears.
“something is wrong with the Turing test”
Nope, there’s nothing wrong with the test. It wasn’t designed to test if it was “strong AI” or anything like that, it was designed to answer the question “Can machines think?” and at this point, the clear answer is yes they can.
Are they perfect? No. Can you trip them up? Yes.
Are both of those previous answers also true for humans? Yes.
There’s plenty of humans that would struggle with counting the number of “r” in Strawberry, and most models are well past that level of failure. The current ones even recommend you drive to the car wash even if it’s only 50 feet down the road.
To paraphrase Jordan Peterson, “define think.”
To sum up Alan Turing something can be said to be thinking if it can fool humans in the imitation game.
I don’t find that a particulary satisfying definition, and doubt an up-to-date Alan Turing would either.
I’m not so sure that he would. The whole thing is rather moot though because thinking isn’t a yes or no question.
A fun quote I heard previously, was from someone involved in making bear proof garbage bins stating that there were challenges because there’s a significant overlap between the dumbest humans and the smartest bears.