Skip to content
Updated: 13 min read

AI in the hands of hackers: what new threats does artificial intelligence generate and how to defend against them

A complete guide for leaders on the new era of AI-powered cyber threats. Understand how deepfake and AI-phishing attacks work, and learn how to build an...

Adrian Kwiatkowski Author: Adrian Kwiatkowski

Imagine this scene. It is a Friday afternoon. Your company’s Chief Financial Officer receives an urgent video call on Microsoft Teams. On the screen, he sees the CEO, who is “calling” from the airport. He looks exactly like him, speaks exactly like him, and in the background you can hear the bustle of the terminal. The CEO explains that he is in the process of finalizing a secret, extremely important acquisition and must immediately, within an hour, transfer a deposit to a designated account to close the deal. He stresses that the matter is absolutely confidential and asks that no one else be informed. The CFO, acting in good faith and under enormous pressure of authority, makes the transfer. An hour later, he realizes that he has fallen victim to a scam. The entire video call was a real-time generated deepfake, and the company’s money has irrevocably disappeared.

This is not a movie scenario. In 2025, this is a real, documented and increasingly common threat. The artificial intelligence revolution, which brings so many benefits to companies, has simultaneously democratized and turbocharged the tools available to cybercriminals. AI in their hands becomes a weapon that allows for creating attacks of a scale, precision and level of sophistication that we have not known before. Traditional defensive walls, based on antivirus software and firewalls, are no longer sufficient, because the new generation of attacks targets the weakest link in any security system – the human being.

As a business and technology leader, you must understand the nature of this new war. Ignoring these threats is no longer an option. This guide is a strategic briefing on the new era of cybersecurity. We will explain how hackers are using AI, how deepfake technology is changing the rules of the game in social engineering, and most importantly – how to build a multi-layered defense strategy that combines modern technologies with the most important element: the awareness and resilience of your employees.

What new, AI-powered attacks are revolutionizing the cyber threat landscape in 2025?

Artificial intelligence acts as a powerful force multiplier for cybercriminals, allowing them to automate, scale and personalize attacks on an unprecedented scale.

One of the greatest threats is intelligent, personalized phishing. Instead of sending thousands of identical, generic emails with grammatical errors, AI is able to create thousands of unique, perfectly written and highly personalized messages. The algorithm, by analyzing publicly available data, can craft an email that perfectly imitates your boss’s writing style, references your last joint project and asks for the urgent sending of a confidential document.

Another area is automation of reconnaissance and vulnerability discovery. AI can autonomously scan a company’s IT systems in search of security gaps, operating much faster and more comprehensively than a human hacker.

Adaptive malware is also emerging. Traditional viruses had a fixed code and signatures that antivirus systems learned to recognize. Modern AI-based malware can change its code and behavior during an attack to avoid detection, like a chameleon adapting to its surroundings.

However, the most alarming trend is the use of AI for advanced social engineering, the most powerful tool of which has become deepfake technology.

How is deepfake technology changing the face of phishing and social engineering?

For years, we have been teaching employees not to trust suspicious emails. But what if the threat comes not in the form of text, but in the voice or video of a person they unconditionally trust? This is precisely the revolution brought by deepfake.

This technology, using generative neural networks, allows the creation of extremely realistic, synthetic audio and video recordings. In the context of cyberattacks, we are talking about two main threats.

The first is “vishing” (voice phishing) based on voice cloning. Just a few seconds of a voice sample from your CEO (e.g., from a public speech on YouTube) is enough for AI to learn to imitate it. A cybercriminal can then call an employee in the finance department and, using the cloned voice, issue a payment order.

The second, even more dangerous, is real-time video deepfake, just like in the story from our introduction. This technology allows overlaying a fully animated, realistic mask of another person’s face onto the fraudster’s face during a video call. Combined with a cloned voice, this creates an illusion almost impossible to distinguish from reality with the naked eye. This takes social engineering to an entirely new, frightening level.

What publicly available and specialized AI tools are cybercriminals using today?

The democratization of AI means that tools that just a few years ago were only available in research laboratories are now within reach of everyone – including cybercriminals.

A fundamental tool has become publicly available, large language models (LLMs). Criminals use them for mass generation of credible phishing texts in various languages, creating fake social media profiles or writing simple malware.

Voice cloning and deepfake creation tools are also becoming increasingly accessible. Many of them, created for legitimate purposes (e.g., for the film industry), are being adapted by criminals.

On darknet forums, the “Cybercrime-as-a-Service” model is also developing, where specialized groups offer ready-made AI-based services. There you can “hire” a bot to carry out phishing attacks, buy access to a deepfake-generating platform or order the creation of an adaptive virus.

What new, intelligent defensive tools allow effective protection against AI attacks?

In this new war, fighting fire with fire is becoming a necessity. Traditional, rule-based and signature-based security systems are helpless against dynamic, AI-generated attacks. Therefore, the new generation of defensive tools must also be based on artificial intelligence.

In the area of network and endpoint protection (Endpoint Detection and Response - EDR), modern systems use machine learning for behavioral analysis. Instead of looking for known viruses, they learn what “normal” behavior looks like on the network and on employees’ computers. Any deviation from this norm – for example, unusual network traffic, an attempt to access sensitive files by an atypical process – is immediately flagged as a potential attack.

Specialized deepfake detection tools are also emerging. They analyze video recordings in search of subtle artifacts and inconsistencies, invisible to the human eye, that reveal the synthetic origin of the image.

In email protection, AI-based systems analyze not only content but also metadata and the context of historical communication to identify highly personalized phishing attempts.

What are the best procedural and human practices for defending against deepfake attacks?

Defensive technology is important, but in the case of deepfake attacks that exploit psychology and trust, the most important line of defense is the human being and the procedure.

It is absolutely crucial to implement in the company a multi-level verification principle for all sensitive operations. No phone call or video call from the CEO, no matter how convincingly it sounds, can be a sufficient basis for making a transfer to an unknown account. The process must require confirmation of this instruction through a second, independent channel – for example, by calling back the CEO’s known phone number, sending an SMS with an authorization code or a personal request for approval in the financial system.

It is also essential to build a culture of healthy skepticism. Employees must be trained to approach with limited trust every unexpected and urgent request, especially if it concerns money or data, regardless of who it apparently comes from. They must feel safe to question such a request and ask for its additional verification, without fear of negative consequences.

How are the required competencies in cybersecurity teams evolving in the AI era?

The AI era is forcing an evolution of competencies in security teams. In addition to traditional knowledge of networks, systems and cryptography, new skills are becoming essential.

There is a demand for AI/ML security specialists. These are individuals who understand how machine learning models work and can identify specific attack vectors, such as “poisoning” training data (data poisoning) or adversarial attacks.

The role of analysts and “threat hunters” is growing, who are able to work with AI-based analytical tools, interpret their results and proactively search through vast datasets for traces of advanced, hidden attacks.

Competencies in psychology and social engineering are also becoming crucial, in order to understand how criminals use AI to manipulate people and how to build effective awareness training programs.

What security awareness training is essential for all employees?

In the face of threats such as deepfake, investment in security awareness training programs for all employees is becoming the most important and most effective form of defense.

However, such training must go beyond the outdated formula of an annual, boring click-through presentation. Modern programs are interactive, engaging and continuous. They use phishing and vishing attack simulations to teach employees in a safe environment how to recognize manipulation attempts.

It is crucial that training focuses on specific, practical behaviors rather than on technical theory. Employees need to know exactly what to do when they receive a suspicious request: who to report it to, how to verify the identity of the caller, what communication channels to use for confirmation. Regular, short and engaging formats (e.g., monthly videos, quizzes) are much more effective than one long training session once a year.

Strategic summary: what does the threat and defense mechanism matrix look like in the AI era?

This table presents key AI-powered threats and a multi-layered approach to defense.

AI attack typeThreat descriptionTechnological defenseProcedural and human defense
Personalized Spear PhishingMass generation of unique, highly credible phishing emails that bypass traditional filters.AI-based anti-phishing systems that analyze context and communication style, not just content.Continuous training and phishing simulations. A culture of verifying unusual requests.
Deepfake Voice & Video (Vishing)Impersonation of the voice or image of high-authority individuals (e.g., the CEO) to extort money or data.Deepfake detection tools. Introduction of voice biometrics as an additional authentication factor.Strict implementation of a multi-channel verification procedure for all financial and sensitive operations.
Adaptive MalwareMalicious software that can change its code and behavior to avoid detection by antivirus systems.EDR/XDR systems based on behavioral analysis that detect anomalies in behavior, not just known signatures.Maintaining digital hygiene, the principle of least privilege.
Automated ReconnaissanceUsing AI for continuous scanning of a company’s publicly available infrastructure in search of new vulnerabilities and configuration errors.Attack Surface Management platforms. Continuous vulnerability scanning.Maintaining a regime of system updates and patching. Minimizing publicly exposed services.

How can EITT help build a “human firewall” in your company that is resilient to AI attacks?

At EITT, we have understood for years that technology is only one layer of defense. In the AI era, the most important and simultaneously most attacked layer is the human being. That is why our priority is building a “human firewall” – an organization in which every employee is aware of threats and knows how to respond to them.

We design and implement modern, engaging security awareness programs that are tailored to the specifics and risks of your company. Instead of boring presentations, we use interactive workshops, gamification and advanced, controlled phishing and vishing attack simulations.

For technical and security teams, we offer advanced cybersecurity training in the AI era, teaching them how new attack vectors work and how to use intelligent tools for defense. Our goal is to build multi-level resilience in your company that combines the best technologies with the strongest possible link – an aware and vigilant employee. Summary

Artificial intelligence has opened Pandora’s box in the world of cybersecurity. Threats that were recently the domain of state intelligence agencies are now becoming available to an ever-wider group of criminals. Ignoring this new reality is a straight path to catastrophe. Effective defense requires a holistic approach that combines investments in intelligent defensive technologies with an equally important, and perhaps even more important, investment in building human awareness and resilience. In this new war, your best-trained employee may prove more important than the most expensive firewall.

If you are ready to prepare your organization for the new era of cyber threats and want to build a security culture in your company that is a real defensive shield, contact us. Let us talk about how we can help you in this crucial mission.

Read also

Develop your skills

The topic of this article is related to the training Fundamentals of Artificial Intelligence (AI) and Machine Learning. Check the program and sign up to develop your competencies under the guidance of EITT experts.

Frequently Asked Questions

How do AI-powered phishing attacks differ from traditional phishing?

AI-powered phishing attacks are far more sophisticated because they use large language models to generate unique, grammatically perfect, and highly personalized messages at scale. Unlike traditional phishing with generic templates and obvious errors, AI can analyze publicly available data about a target to mimic writing styles, reference real projects, and create contextually convincing scenarios that bypass both technical filters and human judgment.

Can deepfake technology be reliably detected during a live video call?

Current deepfake detection tools can identify subtle artifacts and inconsistencies in synthetic video, but they are not yet foolproof in real-time scenarios. The most reliable defense remains procedural rather than technological: organizations should implement multi-channel verification protocols that require confirming any sensitive request through a second independent communication channel, regardless of how convincing the caller appears.

What is the most effective first step an organization can take to defend against AI-driven cyber threats?

The most impactful first step is investing in modern, continuous security awareness training for all employees, combined with realistic phishing and vishing simulations. Since AI-powered attacks primarily exploit human psychology and trust rather than technical vulnerabilities, building a vigilant and skeptical workforce creates the strongest defensive layer against these evolving threats.

Are small and medium-sized businesses also targets of AI-powered cyberattacks?

Yes, small and medium-sized businesses are increasingly targeted because AI has dramatically lowered the cost and effort required to launch sophisticated attacks. Cybercriminals can now use automated tools to scan thousands of organizations simultaneously for vulnerabilities, making it economically viable to target smaller companies that often have weaker security measures and less employee awareness training.

Adrian Kwiatkowski
Adrian Kwiatkowski Opiekun szkolenia

Request a quote

Develop Your Competencies

Check out our training and workshop offerings.

Request Training
Call us +48 22 487 84 90