Advertisement

We need your help now

Support from readers like you keeps The Journal open.

You are visiting us because we have something you value. Independent, unbiased news that tells the truth. Advertising revenue goes some way to support our mission, but this year it has not been enough.

If you've seen value in our reporting, please contribute what you can, so we can continue to produce accurate and meaningful journalism. For everyone who needs it.

A doctored photo of Sarah Palin, falsely showing her in a bikini with a gun. Naomi
photoshop job

A tech company has invented an algorithm to prove photos like this are fake

No, Sarah Palin wasn’t really toting a firearm in an American-flag bikini.

HISTORY IS FULL of manipulated images. Adolf Hitler, Joseph Stalin, and Mao Zedong all were known to cut former allies out of historical photos after a disagreement.

Even Winston Churchill wasn’t above tampering with photographs when it suited him.

Back then, you needed special technical equipment and time-consuming darkroom techniques to manipulate an image.

Since photos went digital, however, it has become a lot easier to modify them, and much harder to tell when an image has been tampered with.

But a Czech company has created a product that can do just that, and banks and insurance companies are using it to detect fraud.

Back in 2004, a group of scientists and digital experts led by Babak Mahdian came together in Prague with one goal: to build a toolkit that could instantly detect whether an image had been tampered with.

back-in-2004-a-group-of-scientists-and-digital-experts-led-by-babak-mahdian-came-together-in-prague-with-one-goal-to-build-a-toolkit-that-could-instantly-detect-whether-an-image-had-been-tampered-with Winston Churchill’s cigar was removed from this image after smoking was deemed unhealthy. Verifeyed Verifeyed

They had heard fake IDs were being submitted to banks so people could create fraudulent accounts online, and manipulated images were being used to trick insurance firms.

The team created Verifeyed, which uses machine learning to figure out whether photos have been through editing software and can establish which camera or phone was used to take them.

they-had-heard-fake-ids-were-being-submitted-to-banks-so-people-could-create-fraudulent-accounts-online-and-manipulated-images-were-being-used-to-trick-insurance-firms A senior leader of the Chinese Communist Party was removed from this photograph after falling out with Mao. Verifeyed Verifeyed

Traditional digital cameras have several components: an optical system, then a photo sensor, and finally a storage system. Each component has a unique “fingerprint.”

This “fingerprint” can be unique to a camera or camera model, and it can be corrupted when an image has been tampered with.

the-team-created-verifeyed-which-uses-machine-learning-to-figure-out-whether-photos-have-been-through-editing-software-and-can-establish-which-camera-or-phone-was-used-to-take-them Hitler had propaganda minister Joseph Goebbels removed from the picture. Verifeyed Verifeyed

One of the ways Verifeyed spots fake images is by finding out how many times an image has been compressed into a JPEG file format for storage.

If an image has been tampered with, it is decompressed, loaded onto photo-editing software, manipulated, and recompressed.

JPEG is a “lossy” file format, which means that every time you compress a JPEG image, some information is lost to make a smaller file.

if-an-image-has-been-tampered-with-it-is-decompressed-loaded-onto-photo-editing-software-manipulated-and-recompressed Italian dictator Benito Mussolini had the horse-handler removed to appear more heroic. Verifeyed Verifeyed

When a JPEG image is compressed, it is split into adjacent blocks of pixels. Those blocks are compressed separately but still have to relate to one another in the same way they would in the original image.

If someone has made changes to parts of the image, the changes will not relate to one another in the same way. The Verifeyed algorithm is able to spot these differences.

Once it was created, Verifeyed took on contracts with a bank, a media agency, and two insurance firms.

traditional-digital-cameras-have-several-components-an-optical-system-then-a-photo-sensor-and-finally-a-storage-system-each-component-has-a-unique-fingerprint A fraudster tried to trick an insurance company by making it look as if a car had been damaged. Verifeyed Verifeyed

After six months reviewing over 1.5 million images, about 2% of the images Verifeyed flagged were false positives — real photos incorrectly flagged as fake.

That isn’t a large percentage. But if an insurance company received 4 million digital images annually, that would mean 80,000 false alarms. A lot of customers could be falsely accused of fraud.

And the Verifeyed product took one or two seconds to process each photo. A company can have thousands of photos to get through daily, so the process took too long.

if-someone-has-made-changes-to-parts-of-the-image-the-changes-will-not-relate-to-one-another-in-the-same-way-the-verifeyed-algorithm-is-able-to-spot-these-differences French magazine Paris Match altered a photograph of President Nicolas Sarkozy by removing some body fat. Verifeyed Verifeyed

The team went back to the drawing board. Verifeyed’s clients wanted a system that wasn’t too slow or too sensitive.

After some improvements, only 0.01% of the digital images Verifeyed examines are false positives, and it gets through images in less than a second.

Verifeyed, which now has nine people on its team, did not disclose its revenues to us. Mahdian also says the company has not raised any venture capital funding.

Instead, Mahdian says, Verifeyed has relied on a few business angels, like Jan Stok, the CEO of insurance firm MAI Insurance CEE. The team also uses the resources of its parent company, a computer vision development firm called ImageMetry.

instead-mahdian-says-verifeyed-has-relied-on-a-few-business-angels-like-jan-stok-the-ceo-of-insurance-firm-mai-insurance-cee-the-team-also-uses-the-resources-of-its-parent-company-a-computer-vision-development-f Verifeyed CEO Babak Mahdian and CTO Radim Nedbal, with Michael Bloomberg, won the NYC Next Idea competition in 2011. Verifeyed Verifeyed

Here are some examples of famous fakes:

and-the-verifeyed-product-took-one-or-two-seconds-to-process-each-photo-a-company-can-have-thousands-of-photos-to-get-through-daily-so-the-process-took-too-long Verifeyed Verifeyed

A photo of Sarah Palin was went viral shortly after Palin was announced as the vice-presidential nominee for the Republican ticket, depicting her in a patriotic bikini holding a rifle. It was actually a composite of Palin’s head and somebody else’s body. CNN believed it was real for a time.

the-team-went-back-to-the-drawing-board-verifeyeds-clients-wanted-a-system-that-wasnt-too-slow-or-too-sensitive Verifeyed Verifeyed

The Orthodox Israeli newspaper Yated Neeman digitally removed two female Cabinet members from a photo of Prime Minister Benjamin Netanyahu (centre left) and President Shimon Peres (centre right), replacing the women with male Cabinet members.

that-isnt-a-large-percentage-but-if-an-insurance-company-received-4-million-digital-images-annually-that-would-mean-80000-false-alarms-a-lot-of-customers-could-be-falsely-accused-of-fraud Verifeyed Verifeyed

A Russian newspaper distributed by a pro-Kremlin group printed a manipulated image supposedly showing blogger/activist Aleksei Navalny standing beside Boris A. Berezovsky, left, an exiled financier sought by Russian police.

when-a-jpeg-image-is-compressed-it-is-split-into-adjacent-blocks-of-pixels-those-blocks-are-compressed-separately-but-still-have-to-relate-to-one-another-in-the-same-way-they-would-in-the-original-image Verifeyed Verifeyed

The Saudi-owned English news website Al-Arabiya published a photo in which fighter jets were digitally inserted above Libyan rebel fighters near a checkpoint on the outskirts of Ras Lanuf in the north of the country.

READ: An Irish woman’s ‘Hailo for cleaners’ has just been bought for €32 million >

READ: Here’s what your kitchen could look like in 10 years >

Published with permission from
Business Insider
Your Voice
Readers Comments
17
    Submit a report
    Please help us understand how this comment violates our community guidelines.
    Thank you for the feedback
    Your feedback has been sent to our team for review.