Artificial Intelligence helps detect deepfake videos – The Hindu

Original article was published by on artificial intelligence


Researchers at Stanford University and UC Berkeley have devised a programme that uses artificial intelligence (AI) to detect deepfake videos.

The programme is said to spot 80% fakes by recognising minute mismatches in the sounds people make and the shape of their mouths, according to the study titled ’Detecting Deep-Fake Videos from Phenome-Viseme Mismatches.

Deepfake videos can be made using face-swapping or lip sync technologies. Face swap videos can be convincing yet crude, leaving digital or visual artifacts that a computer can detect.

Lip syncing is subtle, and harder to spot. The technology manipulates a smaller part of the image, and then synthesises lip movements that closely match the way a person’s mouth would move if they had said particular words. With enough samples of a person’s image and voice, a deepfake video-maker can manipulate an image to “say” anything, the team said.

The team built a tool to look for ‘visemes’ or mouth formations, and ‘phenomes’ or phonetic sounds.

It tested the tool with an AI-based neural network on videos of former U.S. President Barack Obama. The neural network spotted over 90% of lip syncs involving Obama himself.

Although the program may help detect visual anomalies, deepfake detection is a cat-and-mouse game. As deepfake techniques improve, fewer clues will be left behind, the team said.

Deepfake could also lead to a spike in misinformation which will be much harder to spot.

A letter from the Editor


Dear subscriber,

Thank you!

Your support for our journalism is invaluable. It’s a support for truth and fairness in journalism. It has helped us keep apace with events and happenings.

The Hindu has always stood for journalism that is in the public interest. At this difficult time, it becomes even more important that we have access to information that has a bearing on our health and well-being, our lives, and livelihoods. As a subscriber, you are not only a beneficiary of our work but also its enabler.

We also reiterate here the promise that our team of reporters, copy editors, fact-checkers, designers, and photographers will deliver quality journalism that stays away from vested interest and political propaganda.

Suresh Nambath