GPT-3 is quite impressive in some areas, and still clearly subhuman in others. In Giving GPT-3 a Turing Test, Kevin Lacker found that GPT-3 does well answering simple factual questions like “Who was president of the United States in 1955?”, but also happily answered absurd questions without noticing they didn’t make any sense.
The experiment covers:

Common Sense
Trivia Questions
Logic
and more

View the article: https://lacker.io/ai/2020/07/06/giving-gpt-3-a-turing-test.html