Palo Alto Networks reveals surge in deepfake-driven scams

Palo Alto Networks, a global cybersecurity firm, has released a new research report by its Unit 42 division detailing the emerging dynamics of deepfake scam campaigns on the internet.

The investigation has unveiled a complex and extensive campaign using AI-generated deepfake videos to deceive individuals and organisations in numerous countries.

The research highlighted that more than a dozen scam operations have employed deepfake videos featuring the likenesses of various public figures, including Chief Executive Officers, news anchors, and government officials. This tactic is being used to add a layer of credibility to fraudulent schemes. The deepfake videos were noted to be in multiple languages, including English, Spanish, French, and Russian, and the scams were found across nine countries, such as Canada, France, Mexico, and Singapore.

In these scams, the AI-manipulated videos promoted fake investment opportunities or government-sponsored giveaways. Palo Alto Networks’ investigation suggests the operations may originate from a single threat actor group, as indicated by similarities in the domains and hosting infrastructure used. With hundreds of implicated domains, each receiving an average of 114,000 visits globally, there is a significant potential for extensive victimisation, the company said.

One of the most significant schemes identified involves a fraudulent investment platform called Quantum AI. This particular scam utilised deepfake videos of high-profile figures like Elon Musk to lure victims. Similar methods were employed in other scams, which featured manipulated videos of figures such as Giorgia Meloni, the Prime Minister of Italy, and Tharman Shanmugaratnam, the President of Singapore.

Palo Alto Networks has stressed the importance of proactive measures to combat the growing threat posed by deepfake-based scams. A company spokesperson stated, “Our customers are better protected from these attacks using Advanced URL Filtering, which can detect and block websites used to propagate deepfake-based scam campaigns.”

Palo Alto Networks Unit 42 brings together threat researchers, elite incident responders, and expert security consultants to create an intelligence-driven, response-ready organisation to help manage cyber risk. 

The company affirmed its commitment to ongoing research and monitoring of deepfake scams. It reiterated that its advanced threat detection tools and expertise would continue to ensure the protection of its customers against the evolving threats posed by these sophisticated scams.

This research by Unit 42 underscores the increasing sophistication and reach of cyber threats facilitated by advances in AI technology. The company's investigation highlights the need for robust cybersecurity measures and continued vigilance to protect against such fraudulent schemes.