Saudi Press

Saudi Arabia and the world
Wednesday, Jan 15, 2025

AI is making scams harder to detect, but cyber firms are fighting back

AI is making scams harder to detect, but cyber firms are fighting back

Generative AI is allowing scammers to mimic voices, write more sophisticated phishing emails, and create malware, but cybersecurity firms are fighting back with AI themselves.

Generative artificial intelligence (AI) poses a slew of cybersecurity risks, particularly in social engineering scams that are prevalent in Hong Kong, according to a cybersecurity firm that is also deploying AI to counter the threat.

The emergence of advanced generative AI tools such as ChatGPT will enable certain types of scams to become more common and effective, said Kim-Hock Leow, Asia CEO of Wizlynx Group, a Switzerland-based cybersecurity services company.

“We can see that AI voice and video mimicking continues to seem more genuine, and we know that it can be used by actors looking to gain footholds in a company’s information and cybersecurity [systems],” he said.

Social engineering like those conducted over the phone or through phishing emails are designed to fool victims into believing they are conversing with an authentic person on the other end.

In Hong Kong, scams conducted through online chats, phone calls and text messages have swindled people out of HK$4.8 billion (US$611.5 million). AI-generated audio, video and text are making these types of scams even harder to detect.

In one example from 2020, a Hong Kong-based manager at a Japanese bank was fooled by deepfake audio mimicking his director’s voice into authorising a transfer request for US$35 million, according to a court document first reported by Forbes.

The scammers ultimately made off with US$400,000, as the manager also believed he had emails in his inbox confirming the director’s request.

Just a year earlier, a similar scam led a British energy company to wire US$240,000 to an account in Hungary.

Governments are starting to wake up to the new threat. In February, Beijing’s municipal public security bureau warned in a statement on WeChat that “villains” may use generative AI to “commit crimes and spread rumours”.

In March, the US Federal Trade Commission issued a warning about scammers weaponising AI-cloned voices to impersonate people, adding that all they need is a short audio clip of the person’s voice from online.

A much likelier scenario than AI audio or video, however, is AI-generated text used in phishing emails, according to Leow.

“Everyone gets phishing attacks, but they are sometimes easily detectable due to the length, typos, or because they lack relevant context to you and your job,” he said. “But now, cybercriminals can use new AI language models to increase the sophistication of their phishing emails.”

Banknotes seized as part of scam involving phishing messages sent to Hong Kong residents are seen at police headquarters in Wan Chai. Experts warn that phishing scams could become more sophisticated through the use of AI.


One way this might work is by using a tool like ChatGPT to clean up and professionalise the language of a message. This can include quickly conducting background research on an entity or industry for added contextual information to personalise phishing emails, Leow explained.

Wizlynx, whose clients include finance companies and government-affiliated entities in Hong Kong, and companies like it are now deploying ChatGPT themselves to better fight these more sophisticated scams.

Tactics include using the chatbot to generate phishing emails for training purposes. Wizlynx is also using it to identify vulnerabilities and conduct research on cybersecurity systems.

“Based on the knowledge and data that AI can gather and generate over time, cybersecurity professionals can use it to get more accurate identification of a security system’s risk and vulnerability areas,” Leow said.

“We have to encourage cybersecurity professionals and other industries to make use of ChatGPT itself to improve defences,” he added. “In a way, it is a double-edged sword that will be used for both cybersecurity and cybercrime.”

Some of the threats cybersecurity firms point to remain hypothetical for now. Digitpol, a global provider of digital risk solutions, has warned that AI models can be trained to bypass security filters and detection signatures by quickly writing malware and malicious code.

Leow said he is unsure if AI-generated malware has been used in recent attacks, but noted that currently available security measures can only minimise the risk of these highly sophisticated threats.

“We will have to hope that the owners of ChatGPT and other generative AI models will do everything they can to minimise the chances of abuse by bad actors,” he said.

The terms of service from ChatGPT creator OpenAI prohibit the use of its technology for illicit purposes. The company also has technical solutions in place, but there is a risk that bad actors could bypass ChatGPT’s filters, according to Leow.

Dark web forum posts identified in a January report from Check Point Research indicated that cybercriminals have figured out how to manipulate ChatGPT into producing basic but viable malware.

OpenAI did not respond to a request for comment.

Cybercrime is expected to cost US$8 trillion globally this year in damages that include stolen funds, property loss and reduced productivity, according to a report from Cybersecurity Ventures.

The losses would be larger than the gross domestic product of every country except the US and China.

In the face of this threat, cybersecurity experts will continue to evolve in what is becoming an AI arms race, according to David Fairman, Asia-Pacific chief information officer for Netskope, who previously held top security roles at global banks including Royal Bank of Canada and JPMorgan Chase.

“In the coming years and months, we will see security teams effectively embracing AI to improve threat identification and automate much of the defence process,” he said. “AI is commonly used in many of the latest cybersecurity products that are used by security teams today, and we will see this continue to evolve.”

Newsletter

Related Articles

Saudi Press
0:00
0:00
Close
California Wildfires Set to Become Costliest in U.S. History
U.S. Military Assistance to Israel Surges to $22 Billion in Wake of October 7 Events
Military Appeals Court Upholds 9/11 Plea Deals, Limiting Defense Secretary's Authority
Taliban Imposes New Law: Blocking Windows to Prevent Visibility of Women
Afghanistan has announced war against Pakistan following reports that Pakistani airstrikes killed more than 46 civilians.
Answering incorrectly to the question 'Are you Alawi or Sunni?' in Syria these days could be detrimental to your well-being.
Israeli Military Operations in Gaza, Netanyahu's Corruption Trial, and Global Political Shifts: A Complex Interplay of Geopolitical and Economic Dynamics
Global Developments: Vaccine Controversy, Syrian Rebuilding, Natural Disasters, and Escalating Geopolitical Tensions
Israel's Strategic Maneuvers and U.S. Legal Actions Amidst Syria's Political Upheaval
Global Military Shifts, Gender Inequality, and Economic Alliances: Key Developments in the Post-Assad Era
International Condemnation and Mediation Efforts in Response to Israeli Actions in the Golan Heights Amid Middle Eastern Tensions
Global Tensions and Efforts for Peace: Cross-Cultural Dialogues, Regional Conflicts, and International Diplomacy
Saudi Arabia's Expanding Global Influence: From Water Management Leadership to Cultural and Economic Partnerships
Global Diplomatic Advances: Expanding Judicial, Human Rights, and Geopolitical Partnerships in the Middle East and Beyond
Strengthening UK-Gulf Relations and Addressing Global Challenges: A Diplomatic Overview
Cultural Heritage, Political Change, and Economic Growth: Key Developments Across the Middle East
Key Developments in Middle East Relations, Judicial Reforms, and Energy Partnerships Highlight Saudi Arabia's Vision 2030 Ambitions
Economic Growth and Innovation Drive Middle Eastern Developments: A Look at Egypt's Treasury Bill Success, Saudi Arabia's Expanding US Relations, Sustainability Initiatives, and Vision 2030 Achievements
UK Considers Delisting HTS Amid Complex Regional Dynamics and Global Security Implications
Global Developments: Saudi Arabia Embraces Cashless Innovation, Syria's Human Rights Struggles, Trump's Controversial Plans, Ghana's Leadership Shift, South Korea's Political Crisis, and Saudi-Japan Economic Partnership
Political Turmoil and Economic Ambitions: Macron's Coalition Efforts, MENA Startup Surge, and Global Initiatives in Integration and Innovation
Turkiye Advocates for Syrian Unity Amid Regional Turmoil; Israeli-Lebanese Tensions and Iran's Strategic Moves Highlight Middle Eastern Shifts
Kanlaon Volcano Erupts in the Philippines and Disrupts in the Middle East: Political Shifts, Oil Market Ripples, and Regional Instability
Global Turmoil: Taiwan Enhances Defenses, Indian Schools Face Bomb Hoaxes, and Middle East Conflicts Escalate
Global Political Shifts: From Trump's Strategic Appointments to Middle Eastern Power Realignments
Escalating Conflicts and Strategic Shifts Across the Middle East and North Africa
Syria's Historic Transition: The Fall of Assad and New Geopolitical Dynamics
Global Shifts: Saudi-UK Trade Goals, Syrian Regime Change, and U.S. Post-Assad Strategy
Saudi Arabia's Multi-Faceted Strategy: Embracing Sustainability, Tourism Excellence, and Regional Stability
Saudi Arabia Advances Transparency and Partnerships in Vision 2030 Push
Saudi Arabia Navigates Post-Assad Syria, Fossil Discoveries, and Economic Growth Amidst Regional Turmoil
Geopolitical Maneuvers and Sustainable Developments: Israel's Buffer Zone Tactics, Saudi Arabia's Vision 2030 Innovations, and Egypt's Aviation Advancements
NASA's Artemis II Delayed to 2026, While Saudi Arabia Advances Cultural and Humanitarian Initiatives
Key Global Developments: Saudi Oil Price Adjustments, Surging Makkah Tourism, Syrian Conflict Shifts, and Saudi Pro League Highlights
Global Shifts: Diplomatic Talks, Economic Growth, and Regional Upheavals Reshape the Geopolitical Landscape
Insurgents Enter Damascus as Assad's Regime Faces Historic Collapse
Global Political Shifts: Defense Enhancements, Diplomatic Missions, and Civic Engagement Initiatives
Diplomatic Efforts Highlight Regional Tensions and Cooperation at IISS Manama Dialogue Amidst Humanitarian and Natural Crises
From Gulf Diplomacy to Global Resilience: Key Developments Shaping Regional and International Landscapes
Saudi Arabia Intensifies Immigration Control, Strengthens Diplomatic and Cultural Engagements
Global Political Tensions and Ambitious Developments Amid Regional Security Challenges
Philippines Celebrates Extensive Christmas Season; Saudi Innovations in Maritime Safety, Tourism, and Global Diplomacy; Healthcare Advancements and Regional Tensions Also Spotlighted
PIA Returns to European Skies Amid Saudi Arabia's Vision 2030 and COP16 Initiatives
Global Tensions Rise: Strategic Wins, Diplomatic Strains, and Humanitarian Crises Test Resilience
Global Political Turmoil and Humanitarian Efforts: A Snapshot of International Developments
Tensions and Triumphs: A Global Overview of Diplomatic Efforts, Geological Risks, Corporate Security, Military DEI Debates, Middle Eastern Conflicts, and Notre Dame's Resilient Reopening
Global Developments: Ghana's Election, UK's Smuggling Crackdown, Syrian Conflict Escalation, and US Supreme Court's Jurisdictional Case
Global Conflicts and Humanitarian Crises: A Snapshot of Recent International Developments
Saudi Arabia's Innovations in Marine Science, Arts, Film, Technology, Volunteerism, and Medical Education
Iran's Space Launch Fuels Western Concerns Amid Global Political Unrest
×