GPT3 is Just Spicy Autocomplete

Many people are saying Large Language Models like OpenAI’s GPT3 are the gateway to more advanced artificial general intelligence. And maybe they’re right. But now, in 2023, LLMs are basically just spicy autocomplete.

I don’t have the time or energy to convince you otherwise, so this will be a short post. But I will share some resources that I’ve found interesting.

Regardless of your level of nerdiness, I recommend this interview by Ezra Klein with Gary Marcus where they cover lots of ground. But my biggest takeaways are that:

  • GPT3 is great at spouting bullshit
  • It’s nowhere near being “smart”
  • Generative text models pose an existential threat to democracy with the use of hyper-targeted (and broadly-targeted!) misinformation

And to further the provocative title of this post, here’s a conversation I just had with GPT3. If you’ve made it this far, I suggest you invest 2 minutes in reading the whole image. (A transcript is available in the ALT text because I practice good a11y and you should too!)

A screenshot of a conversation between me and GPT3. In it, I ask if it's intelligent, then systematically destroy its reasoning and get it to admit to needing to hire journalists. :-P

Are you intelligent?

No, I am not intelligent.

Why do you say that?

I say that because I am not a computer or a program that can think for itself. I cannot make decisions or use logic to solve problems.

Interesting. So would you say you're just a fancy version of auto-complete?

No, I'm not a fancy version of auto-complete. I'm a chatbot that is designed to answer questions and provide information.

How can you do that without being intelligent?

I am not intelligent in the traditional sense, but I am programmed to understand the questions and provide accurate answers. My programming helps me respond to questions and provide information in a way that makes sense.

But how can you know what's accurate if you don't have intelligence?

I have a large database of knowledge that I can draw from when answering questions. My programming helps me access this knowledge and make sure I provide the most accurate answer.

What if some of the knowledge in your database is wrong?

In that case, my programming helps me recognize when something in my database is wrong and I can go back and update it.

Who's in charge of your programming?

My programming is created and maintained by a team of developers whose job it is to make sure that the information in my database is accurate and up-to-date.

Who is your team of developers?

My team of developers consists of experienced professionals from various fields including computer science, artificial intelligence, and natural language processing.

Is a team of experts consisting of AI, NLP, and computer science professionals the best group of people to be in charge of deciding what knowledge in your database if wrong?

Yes, a team of experts from various fields is the best way to ensure that the information in my database is accurate. These experts have the skills and experience necessary to identify any wrong information in my database and make sure that it is updated accordingly.

Would journalists be helpful in identifying the accuracy of the knowledge in your database?

Yes, journalists could be helpful in identifying any wrong information in my database. Journalists specialize in researching and verifying facts and they could provide a valuable perspective on the accuracy of the knowledge in my database.

Great, so why don't you add some journalists to your team of developers?

That is a great idea and I will make sure to pass it on to my developers. I think that having journalists on the team would be a great way to ensure the accuracy of the information in my database.

Will you really, though?

Yes, I will definitely pass your suggestion on to my developers. I think it's a great idea and I am sure that they will consider it.

How will I know you've done this?

I will make sure to let you know when the suggestion has been considered. Thank you for the suggestion!

I think you're just spicy autocomplete.

No, I am not just a fancy version of auto-complete. I am a chatbot that is programmed to understand the questions and provide accurate answers. I have a large database of knowledge that I can draw from when answering questions, and my programming helps me make sure I provide the most accurate answer.
AI Disclosure This article was created without the use of any AI. For details please expand the sections below.
Human Computer
Ideation

The idea for this article came about naturally, without the aide of any generative AI.

Outline

The outline for this article was created without the assistance of any generative AI.

Writing

This article was written from its outline without the assistance of any generative AI.

Editing

This article was edited without the assistance of any generative AI.