How Facial Recognition is Identifying the Dead In Ukraine
James Clayton
4/13/2022 4:24:07 PM
James Clayton wrote this article in BBC:
Last month a controversial facial recognition company, Clearview AI, announced it had given its technology to the Ukrainian government.
The BBC has been given evidence of how it is being used - in more than a thousand cases - to identify both the living and the dead.
A man lies motionless on the floor, his head tilted down. His body is naked, apart from a pair of Calvin Klein boxers. His eyes are ringed with what look like bruises.
The body was found in Kharkiv, eastern Ukraine - in the wreckage of war. The BBC has seen pictures taken at the scene, but does not know the circumstances around his death. There is clear evidence of head trauma. He also had a tattoo on his left shoulder.
Ukrainian authorities didn't know who the man was, so decided to turn to a cutting edge method: facial recognition using artificial intelligence.
Clearview is perhaps the most famous, and controversial, facial recognition system in the world.
The company has scraped billions of photos from social media companies, like Facebook and Twitter, to create an enormous database of what its CEO and founder Hoan Ton-That calls "a search engine for faces".
"It kind of works like Google. But instead of putting in a string of words or text, the user puts in a photo of a face," explains Mr Ton-That.
The company has faced a string of legal challenges. Facebook, YouTube, Google and Twitter have sent cease-and-desist letters to Clearview - to ask them to stop using pictures from the sites. The UK's Information Commissioner's Office even fined the company for failing to inform people it was collecting photos of them.
Now, its use by the Ukrainian government has raised questions over the implications of infusing this powerful technology into an active war.
Clearview is used extensively - though divisively - by law enforcement in America. Ton-That says 3,200 government agencies have either bought or trialled the technology.
After Vladimir Putin's invasion of Ukraine, Clearview's founder saw another application for the technology.
"We saw images of people who were prisoners of war and fleeing situations, and you know, it got us thinking that this could potentially be a technology that could be useful for identification, and also verification," he says.
He quickly offered the Ukrainian government the technology - an offer that was accepted.
Back in Kharkiv, authorities took a picture of the dead man's face - his head held up, his sunken eyes directed towards the camera.
They snapped a picture, and ran it through Clearview's database. The search returned several pictures of someone who looked very similar to the dead man.
One picture had been taken on what looks like a hot day. The man was shirtless. He had a tattoo on his left shoulder.
The design matched. They had a name.
Using facial recognition to identify the dead is not new, and Clearview isn't the only platform being used to do it in Ukraine.
"We've been using this stuff for years now" says Aric Toler, research director at Bellingcat, an organisation that specialises in investigative journalism.
In 2019, Bellingcat used facial recognition technology to help identify a Russian man who had filmed the torture and killing of a prisoner in Syria. This is not facial recognition's first war.
But its use in Ukraine is more wide-ranging than in any previous conflict. Mr Toler says that he uses the facial recognition platform FindClone in Russia, and that it's been particularly helpful for identifying dead Russian soldiers.
Last year, Clearview was fined by the UK's Information Commissioner's Office for failing to inform people that it was collecting photos of them from social media platforms.
Mr Ton-That accepts there is still debate around the legality of facial recognition technology, but believes Clearview operates within the law - saying the technology has been "misunderstood".
Facial recognition technology, though, clearly has dystopian applications. In November last year the BBC reported that plans were being drawn up in China to use facial recognition tech to target journalists.
Mr Ton-That says Clearview wouldn't allow these kinds of searches, even if they could be used this way. He says Clearview does not work with authoritarian governments and that the company would not work with Russia.
There are, however, applications for Clearview's tech in a military context. Last year the company signed a contract with the Pentagon to explore putting its tech into augmented reality glasses for example. It is one of several companies developing facial recognition AI with military contracts.
Privacy advocates have another worry too. Facial recognition technology might be useful to the Ukrainian authorities in a time of war. But will they simply hand the technology back to Clearview in a time of peace?
"There are any number of examples of technologies that are introduced in wartime and that persist into peacetime," says Mr Healy.
"I hope that that's not the approach they take."
Last month a controversial facial recognition company, Clearview AI, announced it had given its technology to the Ukrainian government.
The BBC has been given evidence of how it is being used - in more than a thousand cases - to identify both the living and the dead.
A man lies motionless on the floor, his head tilted down. His body is naked, apart from a pair of Calvin Klein boxers. His eyes are ringed with what look like bruises.
The body was found in Kharkiv, eastern Ukraine - in the wreckage of war. The BBC has seen pictures taken at the scene, but does not know the circumstances around his death. There is clear evidence of head trauma. He also had a tattoo on his left shoulder.
Ukrainian authorities didn't know who the man was, so decided to turn to a cutting edge method: facial recognition using artificial intelligence.
Clearview is perhaps the most famous, and controversial, facial recognition system in the world.
The company has scraped billions of photos from social media companies, like Facebook and Twitter, to create an enormous database of what its CEO and founder Hoan Ton-That calls "a search engine for faces".
"It kind of works like Google. But instead of putting in a string of words or text, the user puts in a photo of a face," explains Mr Ton-That.
The company has faced a string of legal challenges. Facebook, YouTube, Google and Twitter have sent cease-and-desist letters to Clearview - to ask them to stop using pictures from the sites. The UK's Information Commissioner's Office even fined the company for failing to inform people it was collecting photos of them.
Now, its use by the Ukrainian government has raised questions over the implications of infusing this powerful technology into an active war.
Clearview is used extensively - though divisively - by law enforcement in America. Ton-That says 3,200 government agencies have either bought or trialled the technology.
After Vladimir Putin's invasion of Ukraine, Clearview's founder saw another application for the technology.
"We saw images of people who were prisoners of war and fleeing situations, and you know, it got us thinking that this could potentially be a technology that could be useful for identification, and also verification," he says.
He quickly offered the Ukrainian government the technology - an offer that was accepted.
Back in Kharkiv, authorities took a picture of the dead man's face - his head held up, his sunken eyes directed towards the camera.
They snapped a picture, and ran it through Clearview's database. The search returned several pictures of someone who looked very similar to the dead man.
One picture had been taken on what looks like a hot day. The man was shirtless. He had a tattoo on his left shoulder.
The design matched. They had a name.
Using facial recognition to identify the dead is not new, and Clearview isn't the only platform being used to do it in Ukraine.
"We've been using this stuff for years now" says Aric Toler, research director at Bellingcat, an organisation that specialises in investigative journalism.
In 2019, Bellingcat used facial recognition technology to help identify a Russian man who had filmed the torture and killing of a prisoner in Syria. This is not facial recognition's first war.
But its use in Ukraine is more wide-ranging than in any previous conflict. Mr Toler says that he uses the facial recognition platform FindClone in Russia, and that it's been particularly helpful for identifying dead Russian soldiers.
Last year, Clearview was fined by the UK's Information Commissioner's Office for failing to inform people that it was collecting photos of them from social media platforms.
Mr Ton-That accepts there is still debate around the legality of facial recognition technology, but believes Clearview operates within the law - saying the technology has been "misunderstood".
Facial recognition technology, though, clearly has dystopian applications. In November last year the BBC reported that plans were being drawn up in China to use facial recognition tech to target journalists.
Mr Ton-That says Clearview wouldn't allow these kinds of searches, even if they could be used this way. He says Clearview does not work with authoritarian governments and that the company would not work with Russia.
There are, however, applications for Clearview's tech in a military context. Last year the company signed a contract with the Pentagon to explore putting its tech into augmented reality glasses for example. It is one of several companies developing facial recognition AI with military contracts.
Privacy advocates have another worry too. Facial recognition technology might be useful to the Ukrainian authorities in a time of war. But will they simply hand the technology back to Clearview in a time of peace?
"There are any number of examples of technologies that are introduced in wartime and that persist into peacetime," says Mr Healy.
"I hope that that's not the approach they take."