How Hackers Use AI for Illegal Activities: Real Uses and How to Defend

Hackers use AI mainly as a productivity tool across familiar attack stages. Google and OpenAI report attackers using chatbots to research targets and vulnerabilities, write and fix scripts, translate and polish phishing, and troubleshoot malware. Google also reported in November 2025 experimental malware that calls AI models while running, though at an early stage.

Feb 28, 2025 - 11:26
Updated: 
102.4k

AI in Cybersecurity in Cybersecurity & Ethical Hacking · Tutorial

How Hackers Use AI for Illegal Activities: Real Uses and How to Defend

Quick answer: Hackers use AI mainly as a productivity tool across familiar attack stages. Google and OpenAI report attackers using chatbots to research targets and vulnerabilities, write and fix scripts, translate and polish phishing, and troubleshoot malware. Google also reported in November 2025 experimental malware that calls AI models while running, though at an early stage. A second category is attacks on AI itself, such as prompt injection against company chatbots. The defence is mostly known security done faster: patch exploited flaws quickly, harden identity, watch for unusual behaviour rather than fixed signatures, and secure your own AI applications against the OWASP LLM risks.

Key takeaways

  • Documented misuse is mostly research, coding help, translation and phishing.
  • No report reviewed here shows AI creating new attack classes.
  • AI-assisted malware is emerging but experimental.
  • Your own AI apps are a new target: prompt injection and data leakage.
  • Faster patching and behaviour-based detection matter more than AI-specific tools.

Table of Contents

What Do Threat Reports Actually Show?

Google's January 2025 analysis of government-backed actors using Gemini found them using it for research, coding help and content, without new capabilities. OpenAI's October 2025 report describes accounts trying to refine credential stealers and remote access tools, and concludes attackers add AI to old playbooks. The UK NCSC expects AI to help exploit known vulnerabilities faster by 2027, while judging fully automated advanced attacks unlikely in that period.

How Does AI Fit Into Attack Stages?

StageReported AI useMatching defence
ReconnaissanceSummarising public information on targets and technologiesReduce public exposure, monitor brand mentions
Initial accessFluent, localised phishing; researching public flawsPhishing-resistant MFA, patch KEV flaws first
ToolingDebugging scripts, adding evasion featuresBehaviour-based EDR, application control
Fraud and influenceFake personas, scam scripts, translated contentVerification procedures, takedown requests

For more on automation claims, see can AI automate cyber attacks.

Is AI Writing Malware Now?

Google GTIG's November 2025 report described malware that queries AI models during execution to change its own code or generate commands, and called these early or experimental. It also found underground forums selling AI tools for malware and phishing. The practical lesson: signatures alone age faster when code can change, so detection should focus on behaviour such as unusual process chains, credential access and outbound connections to unexpected services.

How Are AI Systems Themselves Attacked?

RiskWhat it means
Prompt injectionHidden instructions in input make a chatbot ignore its rules
Sensitive information disclosureThe model reveals data it can access
Excessive agencyAn AI agent with broad permissions takes harmful actions
Supply chainTampered models or plugins

These come from the OWASP Top 10 for LLM Applications. MITRE ATLAS catalogues real adversary techniques against AI systems in the style of ATT&CK.

How Should Security Teams Defend?

  1. Patch internet-facing systems against known exploited flaws within days.
  2. Replace SMS codes with passkeys or security keys for staff and admins.
  3. Tune detection for behaviour, not only file hashes.
  4. Give AI agents least privilege and keep humans approving risky actions.
  5. Keep CERT-In mandated logs for 180 days and report qualifying incidents within 6 hours.

Background on the wider trend is in the dark side of AI in cybercrime.

Red teaming your own AI apps or networks needs written authorisation. Unauthorised access is an offence under Sections 43 and 66 of India's IT Act 2000. Security teams can ask about AI security training.

References

Frequently Asked Questions

Threat reports show research, writing and fixing code, translating and polishing phishing, and creating fake personas, mostly to work faster.

Google and OpenAI report no new attack classes so far. AI mainly speeds up existing techniques and lowers the skill needed to use them.

Google GTIG reported experimental malware in 2025 that queries AI models while running, but described it as early stage rather than widespread.

Prompt injection hides instructions in text or documents that an AI system reads, tricking it into ignoring its rules or leaking data.

MITRE ATLAS catalogues adversary techniques against AI, and the OWASP Top 10 for LLM Applications lists the main application risks.

Not first. Fast patching, phishing-resistant MFA and behaviour-based detection counter most AI-assisted attacks; AI tools can help later.

The NCSC expects AI to help attackers exploit known vulnerabilities faster, shrinking the time between a flaw being published and being used.

Yes, with written authorisation from the system owner. Unauthorised testing of others’ systems is an offence under India’s IT Act.

What's Your Reaction?

Like Like 0
Dislike Dislike 0
Love Love 0
Funny Funny 0
Wow Wow 0
Sad Sad 0
Angry Angry 0
Vaishnavi

Vaishnavi is a skilled tech professional at the Ethical Hacking Training Institute in Pune, responsible for managing and optimizing the technical infrastructure that supports advanced cybersecurity education. With deep expertise in network security, backend operations, and system performance, she ensures that practical labs, online modules, and assessments run smoothly and securely. Her behind-the-scenes contributions play a vital role in delivering a seamless and secure learning experience for aspiring ethical hackers.