AI for Ethical Hackers and Cybercriminals: A Dual-Use Map and What Defenders Can Do

Discover how AI tools like WormGPT, Code Llama, and AutoGPT are being used by both ethical hackers and cybercriminals for red teaming, phishing, malware creation, and exploitation. Learn key use cases, risks, and how to stay protected.

Jul 01, 2025 - 14:09
Updated: 15 days ago
101.9k
AI for Ethical Hackers and Cybercriminals: A Dual-Use Map and What Defenders Can Do

Quick answer: AI speeds up both sides of security. Defenders use it for scripting, simulations, summarising and attack surface mapping, while criminals use it for convincing phishing, faster malware changes, deepfake fraud and reconnaissance. Counter with phishing-resistant MFA, behaviour-based detection, out-of-band payment checks, patching and least privilege for AI tools.

Key takeaways

  • AI is dual-use: the same capability speeds up defenders and attackers.
  • Better phishing and deepfakes call for phishing-resistant MFA and out-of-band payment verification.
  • Behaviour-based detection beats signatures against rapidly changed malware.
  • Give AI tools least privilege and treat their input and output as untrusted.

Why is AI a dual-use technology?

A tool that writes code, drafts convincing text, mimics a voice or reads thousands of pages in minutes helps whoever uses it. In security that means defenders and attackers get faster at the same things. This article maps the main categories of AI use on each side and, for each, what defenders can do. It does not give instructions for attacking anyone. Any testing you do must be on your own lab or with written authorisation, since the IT Act applies whatever tool you use.

Quick view: the same capability, two uses

AI capabilityDefensive and authorised useCriminal useBest counter
Code assistanceSpeed up scripts, log parsers and secure code reviewFaster malware variants and obfuscationBehaviour-based EDR, application control
Text generationPhishing simulations and awareness trainingConvincing, personalised phishing at scalePhishing-resistant MFA, context-aware mail filtering, reporting culture
Voice and video synthesisPermissioned drills that test payment verificationImpersonating executives or relatives for fraudOut-of-band call-back, dual approval for payments
Automated research agentsMapping your own attack surfaceFinding exposed systems and building target lists fasterReduce exposure, patch, monitor internet-facing assets
Fuzzing and analysisFinding bugs for responsible disclosureFinding bugs to exploit before patchesFaster patching, defence in depth
Attacks on AI systems themselvesTesting your own chatbots for prompt injectionHijacking assistants to leak dataLeast privilege for AI tools, input and output controls

1. Code assistants

Defenders: assistants help write detection scripts, review code for common flaws and explain unfamiliar code. Treat the output as a draft, since it can contain bugs and insecure patterns.

Attackers: the same speed-up applies to writing and rewriting malicious code, which weakens signature-only antivirus.

What to do: rely on behaviour detection rather than file signatures alone, restrict script execution where you can, and log process creation.

2. Generative text and phishing

Poor spelling used to be a giveaway. Language models remove that tell, and can personalise messages with details gathered from public profiles. Underground tools such as WormGPT were reported in 2023, and a stream of clones followed. Their claims often outrun their quality, but the direction is clear.

What to do:

  • Use phishing-resistant MFA (passkeys or hardware security keys) so a stolen password or one-time code is not enough.
  • Authenticate your own domains with SPF, DKIM and DMARC.
  • Train staff to verify requests by another channel, especially for money or credentials, and make reporting easy.
  • Run authorised simulations using a proper platform with written approval.

3. Deepfake voice and video

Synthetic voice and video have been used in payment fraud, including a widely reported 2024 case in Hong Kong in which an employee was deceived on a video call with fake colleagues. The lesson is not to trust a face or voice alone.

What to do: require a second, independent confirmation for payments and credential resets, such as a call-back to a known number, and use dual approval for large transfers. Agree a code phrase for high-risk requests inside families and teams.

4. Automated reconnaissance

Agents that combine search, scanning data and summarisation shorten the time between "a service is exposed" and "someone has noticed". Defenders can use the same approach on themselves, running authorised discovery on their own assets and fixing what they find.

What to do: keep an inventory of internet-facing systems, patch fast, close unneeded ports and monitor for scans against you.

5. What is AI-assisted bug finding?

Fuzzing and code analysis, with or without machine learning, find vulnerabilities faster. Researchers use this for responsible disclosure, and criminals can use it too. Faster patch cycles and layered defences matter more as discovery speeds up.

6. What are attacks on AI systems?

When a company deploys a chatbot or agent connected to internal data, attackers target it. Prompt injection hides instructions in text the model reads. See the OWASP project for guidance on risks to LLM applications: OWASP.

What to do: give AI tools the least access they need, treat their input and output as untrusted, require human approval for sensitive actions and log what they do.

What this means for your career

Defenders who understand how AI is used against them detect and respond better. Ethical hackers who use AI should do so inside a lab or contract, keep client data out of public tools and verify every output. Learning the fundamentals, such as networking, Linux, web security and scripting, matters more than ever because they let you judge what AI produces.

Next steps

To build the fundamentals, see the AI Security and LLM Security course. Related reading: how hackers use AI for cybercrime and AI tools used by ethical and black-hat hackers.

Frequently Asked Questions

AI helps defenders triage alerts, write scripts, summarise logs and detect anomalies, and helps attackers write convincing messages, change malware faster and automate research. It speeds both sides, so fundamentals and layered controls matter.

They use AI to draft scripts, summarise scan output, explain unfamiliar code and write reports, always inside authorised scope and a lab. They verify outputs and keep client data out of public services.

WormGPT was an underground chatbot reported in 2023 and promoted for writing phishing and malicious code without safeguards. Several clones followed. Claims about such tools are often exaggerated, but they show the direction of misuse.

Criminals clone voices or faces to impersonate executives or relatives and push victims to send money or reset credentials. Defend with call-backs to known numbers, dual approval for payments and verification by a second channel.

Prompt injection hides instructions in text that an AI system reads so it behaves in ways its operator did not intend, for example leaking data. Limit the AI's access, treat inputs as untrusted and require approval for sensitive actions.

AI can make phishing more convincing and so help steal codes or session tokens, but MFA itself is not broken by AI. Phishing-resistant methods such as passkeys and security keys tie authentication to the real site and resist this.

Yes. Agents can combine search and scan data to find exposed systems faster. Defenders can run the same discovery on their own assets, then fix exposure, patch quickly and monitor for scans.

What's Your Reaction?

Like Like 0
Dislike Dislike 0
Love Love 0
Funny Funny 0
Wow Wow 0
Sad Sad 0
Angry Angry 0
Vaishnavi

Vaishnavi is a skilled tech professional at the Ethical Hacking Training Institute in Pune, responsible for managing and optimizing the technical infrastructure that supports advanced cybersecurity education. With deep expertise in network security, backend operations, and system performance, she ensures that practical labs, online modules, and assessments run smoothly and securely. Her behind-the-scenes contributions play a vital role in delivering a seamless and secure learning experience for aspiring ethical hackers.