Saudi Press

Saudi Arabia and the world
Tuesday, Sep 10, 2024

AI is making scams harder to detect, but cyber firms are fighting back

AI is making scams harder to detect, but cyber firms are fighting back

Generative AI is allowing scammers to mimic voices, write more sophisticated phishing emails, and create malware, but cybersecurity firms are fighting back with AI themselves.

Generative artificial intelligence (AI) poses a slew of cybersecurity risks, particularly in social engineering scams that are prevalent in Hong Kong, according to a cybersecurity firm that is also deploying AI to counter the threat.

The emergence of advanced generative AI tools such as ChatGPT will enable certain types of scams to become more common and effective, said Kim-Hock Leow, Asia CEO of Wizlynx Group, a Switzerland-based cybersecurity services company.

“We can see that AI voice and video mimicking continues to seem more genuine, and we know that it can be used by actors looking to gain footholds in a company’s information and cybersecurity [systems],” he said.

Social engineering like those conducted over the phone or through phishing emails are designed to fool victims into believing they are conversing with an authentic person on the other end.

In Hong Kong, scams conducted through online chats, phone calls and text messages have swindled people out of HK$4.8 billion (US$611.5 million). AI-generated audio, video and text are making these types of scams even harder to detect.

In one example from 2020, a Hong Kong-based manager at a Japanese bank was fooled by deepfake audio mimicking his director’s voice into authorising a transfer request for US$35 million, according to a court document first reported by Forbes.

The scammers ultimately made off with US$400,000, as the manager also believed he had emails in his inbox confirming the director’s request.

Just a year earlier, a similar scam led a British energy company to wire US$240,000 to an account in Hungary.

Governments are starting to wake up to the new threat. In February, Beijing’s municipal public security bureau warned in a statement on WeChat that “villains” may use generative AI to “commit crimes and spread rumours”.

In March, the US Federal Trade Commission issued a warning about scammers weaponising AI-cloned voices to impersonate people, adding that all they need is a short audio clip of the person’s voice from online.

A much likelier scenario than AI audio or video, however, is AI-generated text used in phishing emails, according to Leow.

“Everyone gets phishing attacks, but they are sometimes easily detectable due to the length, typos, or because they lack relevant context to you and your job,” he said. “But now, cybercriminals can use new AI language models to increase the sophistication of their phishing emails.”

Banknotes seized as part of scam involving phishing messages sent to Hong Kong residents are seen at police headquarters in Wan Chai. Experts warn that phishing scams could become more sophisticated through the use of AI.


One way this might work is by using a tool like ChatGPT to clean up and professionalise the language of a message. This can include quickly conducting background research on an entity or industry for added contextual information to personalise phishing emails, Leow explained.

Wizlynx, whose clients include finance companies and government-affiliated entities in Hong Kong, and companies like it are now deploying ChatGPT themselves to better fight these more sophisticated scams.

Tactics include using the chatbot to generate phishing emails for training purposes. Wizlynx is also using it to identify vulnerabilities and conduct research on cybersecurity systems.

“Based on the knowledge and data that AI can gather and generate over time, cybersecurity professionals can use it to get more accurate identification of a security system’s risk and vulnerability areas,” Leow said.

“We have to encourage cybersecurity professionals and other industries to make use of ChatGPT itself to improve defences,” he added. “In a way, it is a double-edged sword that will be used for both cybersecurity and cybercrime.”

Some of the threats cybersecurity firms point to remain hypothetical for now. Digitpol, a global provider of digital risk solutions, has warned that AI models can be trained to bypass security filters and detection signatures by quickly writing malware and malicious code.

Leow said he is unsure if AI-generated malware has been used in recent attacks, but noted that currently available security measures can only minimise the risk of these highly sophisticated threats.

“We will have to hope that the owners of ChatGPT and other generative AI models will do everything they can to minimise the chances of abuse by bad actors,” he said.

The terms of service from ChatGPT creator OpenAI prohibit the use of its technology for illicit purposes. The company also has technical solutions in place, but there is a risk that bad actors could bypass ChatGPT’s filters, according to Leow.

Dark web forum posts identified in a January report from Check Point Research indicated that cybercriminals have figured out how to manipulate ChatGPT into producing basic but viable malware.

OpenAI did not respond to a request for comment.

Cybercrime is expected to cost US$8 trillion globally this year in damages that include stolen funds, property loss and reduced productivity, according to a report from Cybersecurity Ventures.

The losses would be larger than the gross domestic product of every country except the US and China.

In the face of this threat, cybersecurity experts will continue to evolve in what is becoming an AI arms race, according to David Fairman, Asia-Pacific chief information officer for Netskope, who previously held top security roles at global banks including Royal Bank of Canada and JPMorgan Chase.

“In the coming years and months, we will see security teams effectively embracing AI to improve threat identification and automate much of the defence process,” he said. “AI is commonly used in many of the latest cybersecurity products that are used by security teams today, and we will see this continue to evolve.”

Newsletter

Related Articles

Saudi Press
0:00
0:00
Close
From Unfounded Conspiracies in Ohio to Global Tensions: A Look at Key Political and Economic Developments
Kim Jong Un Announces Increase in North Korea's Nuclear Arsenal
Deadly Floods Devastate Morocco and Algeria, Libya’s Oil Crisis Escalates, and Global Leaders React to Putin's Ukraine War
Saudi Stock Market Slumps as Al-Rajhi Bank Rises; Middle East Faces Diplomatic and Security Challenges
Palestinians Push for UN Resolution to End Israel's 'Unlawful Presence'; Global Reactions and Regional Tensions Highlighted
Dutch Court Sentences Pakistani Men for Incitement to Murder Over Geert Wilders' Cartoon Contest
Qassim's Commercial Boom and Global Diplomatic Push: Key Developments from Saudi Arabia to Gaza
Hundreds Mourn US-Turkish Activist Killed by Israeli Forces in West Bank: A Multifaceted Overview of Global Developments
Saudi Leaders Strengthen Global Ties at GCC-India Meeting and International Events
Saudi Arabia Unveils Phase 2 of King Fahd Cultural Center Amidst Global Developments
Saudi Crown Prince Meets Russian FM; GCC-Indonesia Trade Talks Begin; Saudi Achievements Highlighted in Global Forums
Pope Francis Visits East Timor: A Landmark Journey for Unity and Hope
Global Turmoil: Jailbreak in Portugal, Tragedy in Nigeria, US School Shooting, Afghanistan's Malnutrition Crisis, Saudi Arabia’s FinTech Boom, and Sudan Conflict Escalation
Trigana Air Incident Highlights Indonesia's Aviation Challenges; Saudi Mortgage Boom and New India Sea Route; UAE's GDP Growth; Kentucky Manhunt Suspends Schools
Make Army Real Again
Bangladesh Seeks Extradition of Sheikh Hasina for War Crimes Amid Global Tension and Tragedies
Iraq and U.S. Plan Military Pullout Amid Regional Shifts; Pentagon Warns of Budget Impacts
Severe Flooding in Morocco Leaves 4 Dead and 14 Missing
Global Tensions Rise: From Egypt's Quest for Nefertiti's Return to Russian Drone Incursions and Migrant Tragedies in the Mediterranean
Amid Regional Unrest, Saudi Leaders Congratulate Algerian President on Controversial Re-election
From Saudi Date Harvest to Turkish Military Secular Oath: Global Updates
Saudi-Egyptian Diplomacy Strengthened as GCC Ministers Convene and Saudi Debt Market Doubles Amid Jeddah Tourism Boost
Kamala Harris Launches 'New Way Forward' Campaign as Saudi Arabia Advances Economic Vision and Bangladesh Seeks Aid for Rohingya Crisis
Global Updates: Trump’s Sentencing Delayed, Innovations in Saudi Healthcare, and Humanitarian Efforts for Gaza
Saudi Arabia Awards $6.13 Billion in Contracts for AMAALA Tourism Project Amidst Vision 2030 Success
Saudi Arabia to Host UN World Data Forum 2026, UK Suspends Arms Sales to Israel, and Major Economic Developments Affecting Global Markets
Iran's President to Visit Iraq Amidst Regional Turmoil, Saudi Aramco Adjusts Oil Prices, and Humanitarian Efforts Continue in Yemen
Saudi Arabia to Host 2026 UN World Data Forum: A Hub for Global Statistical Innovation and Collaboration
Middle East Turmoil and Economic Shifts: Gaza Conflict, Saudi Restructuring, and Omani Credit Growth
Venezuelan Opposition Leader Seeks Asylum in Spain Amid Election Crisis
Paris Court Charges Duo for Plotting Terrorist Attacks Amid Heightened Iran-Europe Tensions
Global Tensions and Tech Unveilings: From Ukrainian Shelling in Russia to AI Innovations in Berlin
Gaza War Marks Its 12th Month
Saudi Arabia Honors Cultural Pioneers Amidst Broader National Challenges
Jill Stein Criticizes US-Israel Ties, Pakistani Academic Defies Norms, and Tragedy Strikes British Tycoon: Today's Top Stories
Riyadh Mayoralty Inaugurates Second Nursery and Saudi Red Crescent's Air Ambulance Heroics Highlight Healthcare Advancements Amidst Regional Tensions
Iran's Missile Support to Russia Raises Global Tensions; Saudi Minister's Innovation Tour in Hong Kong Amid Middle Eastern Conflicts
Saudi Arabia Slashes Customs Fees and Introduces New Yacht Regulations under Vision 2030
Saudi Arabia Eyes Strategic Green Hydrogen Partnerships with Europe Amid Varied Global Crises
Libya Migrant Crisis and Global Tensions: From Deadly Shipwrecks to International Protests and Defense Initiatives
Gaza’s Children Face Grim Future as Conflict Halts Formal Education for Second Year
Escalating Ethnic Violence in Manipur Closes Schools; North Korea's Balloon Stunt Roils Seoul; Pope Calls for Peace in Papua New Guinea Amid Global Tensions
Tim Walz Advocates for Palestinian Rights Amidst Tensions in Gaza, Highlighting Humanitarian Concerns
Saudi Achievements in Cloud-Seeding and Mining Collaborations, Global Calls for Ceasefire, and Biden's Diplomatic Moves
Global Developments: UK Targets Smugglers, Ukraine Seeks Aid, and Thailand Welcomes Youngest PM
U.S. Probes Shooting of Turkish-American Activist by Israeli Forces; NATO Urges China to End Russia Support; Emergency Landing in Turkiye Amid Bomb Threat
Saudi Arabia to Host Groundbreaking Exhibition of Chinese Contemporary Art in Diriyah
Griffon Vultures Revive, New Sports Academy, and FinTech Booms: Saudi Arabia's Multifaceted Progress
Global Unrest: Elephants Rescued in Myanmar, NATO's Appeal to China, and Food Prices Fluctuate Amid Growing Crises
Toronto Film Festival Kicks Off Amid Protests, Tragedy Strikes Kenyan School, Saudi Real Estate Loans Surge, Philippines Ex-Mayor Faces Charges, China Halts International Adoptions, World's Largest Indoor Ski Resort Opens in Shanghai
×