AI-Powered Detection Helps FBI Combat ‘Sextortion’ Scams, Prevents Spread of Deepfake Images
Artificial intelligence (AI) technology is playing a crucial role in the fight against rising sextortion scams, enabling a battle between AI-powered solutions and criminals. The FBI has reported a significant increase in sextortion cases, with a staggering 322% rise between February 2022 and February 2023. These scams involve the manipulation of innocent images into sexually explicit “deepfakes,” posing a serious threat to vulnerable teenagers and preteens.
To address this issue, Canopy, an AI company, has developed software that can detect and block sexually explicit images, including harmless beach or gym pictures, from being shared. The AI platform, honed over 14 years, swiftly analyzes images and videos, effectively filtering out explicit content in real-time as users browse websites or apps, preventing the proliferation of pornography online.
Yaron Litwin, executive of Canopy, describes this technology as “AI for good,” as it provides an extra layer of protection for children and teens, preventing them from unknowingly sharing images that could be used against them by criminals. Moreover, Canopy is collaborating with the FBI, aiding in the identification and filtering of sexual abuse material, sparing investigators from the emotional toll of manually reviewing distressing content.
As AI technology advances, the ongoing battle between AI developers and criminals continues to evolve. Canopy is exploring methods to differentiate between real images and AI-generated fakes, aiming to stay ahead of perpetrators who may attempt to deceive the system.
Sextortion, a crime where victims are coerced into providing sexually explicit images or videos, poses severe psychological harm and has tragically resulted in suicides. The FBI reports a disturbing trend of sextortion cases, particularly affecting males aged 10 to 17. However, victims as young as 7 years old have also been targeted, emphasizing the urgency to combat this form of exploitation.
While reported sextortion cases have surged during the pandemic, it is important to acknowledge that many victims feel shame and do not report the incidents, indicating that the actual number of cases may be significantly higher. Organizations like the National Center for Missing & Exploited Children offer resources and support to help victims navigate these distressing situations, emphasizing the need for open conversations and education to empower young individuals and protect them from online threats.
The deployment of AI-powered technology in combating sextortion scams represents a significant step in safeguarding vulnerable individuals, offering hope in the ongoing fight against digital exploitation and ensuring a safer online environment.