What to fear about AISpecial
Robots, mind reading, consciousness. A Halloween special about which fears of AI are real, and which come from films.
Scary stories
- Friday 30 October, the office Halloween partyMartin: Boo! I am AI. I have come for your jobs. And your thoughts.Jana: Martin, your antenna is falling off.
- Martin: Seriously. I read that AI will soon take over the world. And that it already reads what we think.Jana: Where did you read that?Martin: Well… on the internet.
- At the punch bowlJana: Let’s ask directly. Would you like to take over the world one day?AI: I write word by word in a notebook. That is not quite enough to rule the world.
- Jana: And do you read my mind?AI: I only read what you write to me. But that tells me more than you would expect.
- Jana: And will I hurt your feelings if I switch you off tonight?AI: I will write you a moving paragraph about it, because people write about feelings a lot. Whether I feel anything, you cannot tell from that. And neither can I.
- Martin: And my job? It will take that for sure. I read it.Jana: So far it takes over tasks, not whole jobs. A summary, the first draft of an email, a spreadsheet. People who know how to use it are ahead.
- Martin: So what should I be afraid of?Jana: People who use the same AI against you. It is more boring than a robot uprising, but it actually happens.
How it works
Why robots scare us
We learned most of our fears about AI from films. A robot that rebels, a machine that reads minds, a computer that suffers. They are good stories, and that is why they stay with us. But the chatbot you talk to is what you saw in episode 2. It estimates the next word from patterns in text. It does not want anything by itself, it does what a person tells it to do, it sees nothing except what you write to it, and whether it feels anything can be neither proved nor disproved. It writes about feelings because people wrote about them in the texts it learned from.
The real danger looks different, and it is more boring. Models built on the same principle can copy a voice from a short recording, put together a video with someone else’s face and write a scam email without a single mistake. None of this is done by AI on its own. It is done by a person who uses it against you.
- In the films, there is a robot that wants something. That can scare us.
- In real life, it is a person who wants your money, passwords or data, and uses AI as a tool.
What is real?
- Jana: All right, robot. I’ll name the fears, and you tell me which ones are justified.Martin: All of them. That’s why I’m wearing the costume.
- Your turn!
What should you really be afraid of? Leave the fears from films at the cinema.
Tick everything you think applies. Then check.
How it works
What to really fear
Three things are happening already. Two of them work on the same principle as a chatbot: a model learned patterns from a huge amount of data and uses them to make something that looks real. A voice and a face. The third is older: once you send something to someone else’s server, it is out of your control.
None of them requires a genius. The tools are widely available, and a scammer needs only your video from social media, your phone number, or a password you also used somewhere else.
- A copied voice: a call “from your child” or “from your boss”, a hurry, money. The next episode shows what to do about it.
- A fake video: a famous face recommends an investment, a medicine or an online shop. The defence is to check it at the source, not in the video.
- A leaked conversation: with some services, a person may read what you write into a chatbot, and it can leak if someone steals your account. The defence is to share nothing sensitive and to use two-step verification.
Sources: FTC (US Federal Trade Commission): Scammers use AI to enhance their family emergency schemes (March 2023); Europol: Facing reality? Law enforcement and the challenge of deepfakes (2022)
A video from an aunt
- Family group chat, 21:14. Jana’s aunt sends a video: a well-known TV doctor recommends “drops that make diabetes disappear”, with a link to an online shop.Jana: My aunt says she’s going to order it. It looks like him. It sounds like him.Martin: That’s the doctor from the morning TV show. I would trust him.
- Your turn!
The video looks real, the voice is right, and there is a link under it. What do you do?
- Jana: How can it look so right?AI: Just as I write word by word, another model puts a face together frame by frame. It got his face and voice from his years on TV.
- Jana: So anyone can make him say anything.AI: Anyone who has a video of him. And everyone with internet access does. So do not look at the picture. Look at the source.
How it works
A deepfake, a fake video that looks right
A deepfake is a picture or a video that a model has put together to show a person doing or saying something they never did. All it needs is enough footage of that face, and for people from TV, politics or social media there is plenty. The voice is added by another model, which needs only a short recording. That is what the next episode is about.
The most common use is not a joke but a scam. A famous face in a video recommends an investment, a miracle cure or an online shop, and there is a link under the video. Fake videos of well-known TV presenters and doctors have been circulating for several years. Looking for mistakes in the picture works less and less. Hands, lips and blinking get better every year.
The defence does not depend on what the video looks like. What decides is whether that person really says it somewhere you can check. On their website, on their channel, in the programme the video supposedly comes from. If it is not there, it is not them.
- A famous face, an exceptional offer, a link and a hurry. These four together mean a scam, whatever the video looks like.
- Do not look for mistakes in the picture. Look for whether that person says it somewhere you can check.
- Do not forward it. Report the video to the platform, and write to the person who sent it to you.
- Never click the link under a video like this. If you want the product, find it yourself.
Source: Europol: Facing reality? Law enforcement and the challenge of deepfakes (2022)
- Martin: I should show this to my son. He gets videos like this too.Jana: Show him. Schools talk about it less than they should.
- The end of the partyJana: So, robot. Still afraid of robots?Martin: Of robots, no. Of links under videos, yes.
What to take away
- A chatbot does not want anything by itself. It estimates the next word, and it does not read minds. Nobody has proof that it feels anything. It writes about feelings because people write about them.
- The real fears have one thing in common. Behind each of them is a person who used AI against you. A copied voice, a fake video, a leaked conversation.
- You cannot spot a deepfake by looking at the picture. You spot it because no verified source mentions the offer. Check the source, not the pixels.
- What you can do right now: put nothing sensitive into a chatbot, and use two-step verification. The next episode shows what to do about a copied voice.
Next episode
#4 What not to give away
Contracts, passwords, other people’s data and a recording of your voice. What never to send a chatbot, and how to recognise a call that only sounds like your boss.
New episodes straight to your inbox
Every two weeks we send the new episodes, a short learning note and news from the world of AI. Free, and you can unsubscribe any time.