Deepfake technology has become very difficult to tackle due to sophisticated machine learning algorithms. Now, even when a journalist or bystander provides photo or video evidence, the culprit denies it, claiming that it is the result of deepfake manipulation. Can TEE (Trusted Execution Environment) cryptography technology, like SGX, be used to validate whether a photo is original, taken directly from a camera, and free from any manipulation? This would ensure that the culprit cannot deny the authenticity of the photo. Does it require separate camera hardware, or can the right piece of software alone accomplish this? We can provide these special tools for journalists, etc., to decrease the harm caused by deepfake.
-
1$\begingroup$ If there is no signature, watermark etc when the video capture, the first signer can claim the ownership. $\endgroup$– kelalakaOct 26 at 11:48
-
1$\begingroup$ This is probably closer to applied security, and hence it is probably more on topic on Information Security. See for instance the discussion about deepfake vids here $\endgroup$– Maarten Bodewes ♦Oct 26 at 14:12
-
$\begingroup$ There is work on the finger print of the image sensors so that people can distinguish the cameras individually. It was used in Japan to determine the photographer of (...). They found it and jailed afaik. I'm not a follower of the topic (just know a researcher on the photo capture), but they might carry the fingerprint into video capture, too. This is the best solution if one needs to prove the ownership of the video. $\endgroup$– kelalakaOct 26 at 19:36
-
$\begingroup$ CCD fingerprint method for digital still cameras 2002 $\endgroup$– kelalakaOct 26 at 19:38
-
$\begingroup$ Can't a fingerprint be faked by machine learning after it analyses a few photos of the camera? Blockchain remote attestation while taking pictures seems to be better. $\endgroup$– Amiya BeheraOct 27 at 2:28
1 Answer
The best standard cryptography has to offer is that a photo can be signed by whoever attests that it is original. If we trust the signer and their ability to use their private key wisely (that is not let others use that key, and use it only to sign what they attest is original), and we trust the certification authority (even though some are under control of government actors), then anyone can verify that the photo has been signed and is unaltered, and existed at a certain date. There are issues with resize, crops, edit, but they can be solved by resigning, by the original signer or a trusted third party.
This is feasible with well-established cryptographic techniques, and useful. I hear of an emerging standard.
If we don't thrust the signer and want to put trust in the hardware, e.g. camera, then that's no longer a purely cryptographic problem, and it gets hairy, at multiple levels.
- For a start, what's "original"? Is anything imaged by a physical sensor "original"? What if it is imaged a high-resolution projection onto the sensor? What about physical reality, only staged?
- Trust in the camera signing subsystem. Trusted Execution Environments only make hacking harder, not impossible.
- It seems extremely difficult to guard against insider threats.
For these reasons, I doubt of the economic rationale of trusted hardware to certify photos, except perhaps in some rare contexts where the person that wants to be convinced of the reality of something prepares the hardware. This could apply in some situations: hostages, WMD inspections. Even then, good luck to convince whoever grants access to take the photos that the camera does not contain a GPS tracker or/and a microphone surreptitiously exfiltrating it's output in the certified photo? Or a plain explosive device?
Update: The above forgets that not-so-useful technology can nevertheless become reality in some segment of the market. It's in one recent, expensive camera.
-
$\begingroup$ What if one use remote attestation using blockchain? docs.integritee.network/3-our-technology/3.2-attesteer Yes, there are tee limitations, but can't they be upgraded with time if it breaks, just like we improve cryptography. integritee.network/blog/… The purpose is make it harder, even if not impossible. $\endgroup$ Oct 26 at 14:27
-
1$\begingroup$ Actually, the image sensor has fingerprints. scholar.google.com/… $\endgroup$– kelalakaOct 26 at 14:43