How Hackers Use AI: Techniques Behind Modern Cybercrime and Defences

Hackers use AI for six main techniques: writing convincing phishing messages, impersonating people with cloned voices or deepfake video, creating synthetic identities and documents, getting help with code and scripts, attacking company AI apps through prompt injection, and poisoning data that models learn from. Each has a matching defence. Phishing-resistant MFA and reporting buttons counter AI phishing.

Jul 01, 2025 - 14:41
Updated: 
105.7k

AI in Cybersecurity in Cybersecurity & Ethical Hacking · Explainer

Cyber Threats, Scams & Online Safety

How Hackers Use AI: Techniques Behind Modern Cybercrime and Defences

Quick answer: Hackers use AI for six main techniques: writing convincing phishing messages, impersonating people with cloned voices or deepfake video, creating synthetic identities and documents, getting help with code and scripts, attacking company AI apps through prompt injection, and poisoning data that models learn from. Each has a matching defence. Phishing-resistant MFA and reporting buttons counter AI phishing. Call-back rules stop impersonation. Liveness checks and document verification slow synthetic identities. Patching and EDR limit code-assisted attacks. Input isolation and least privilege reduce prompt injection, and data provenance checks reduce poisoning. Sources include MITRE ATT&CK, MITRE ATLAS and the OWASP LLM Top 10.

Key takeaways

  • Every AI-assisted technique has a known counter-control.
  • Process controls beat detection for deepfake fraud.
  • Company AI apps are now targets in their own right.
  • Prevention, detection and response all matter.
  • Map controls to ATT&CK and ATLAS for coverage.

Table of Contents

Which AI Techniques Do Hackers Use?

Microsoft's February 2024 report found state actors using AI for research, scripting and social engineering. The FBI documented criminals using AI-generated text, images, voice and video for fraud. Attacks on AI systems themselves are catalogued in MITRE ATLAS and NIST AI 100-2 E2025.

Which Controls Counter Each Technique?

Attacker techniquePreventDetect
AI phishing (ATT&CK T1566)Phishing-resistant MFA, link isolationUser reports, mail anomaly alerts
Voice and video impersonationCall-back and dual approval for paymentsUnusual payment requests flagged
Synthetic identity and documentsLiveness checks, document verificationDuplicate device or data patterns
AI-assisted coding of malwarePatching, application controlEDR behaviour alerts
Prompt injection on company AISeparate untrusted content, least privilegeLog and review tool calls
Data poisoningData provenance and access controlModel performance monitoring

How Do You Defend Against Impersonation?

Do not rely on people spotting fakes. Build rules that work even when the fake is perfect:

  • No payment or bank detail change on a call or message alone; call back on a known number.
  • Two-person approval above a set amount.
  • Code words for executives and family members.
  • Phishing-resistant authenticators as described by CISA and NIST SP 800-63B.

How Do You Protect Your Own AI Applications?

The OWASP LLM Top 10 is the practical checklist.

OWASP riskControl
LLM01 Prompt InjectionTreat documents and web content as untrusted; require approval for sensitive actions
LLM02 Sensitive Information DisclosureLimit data the model can reach; filter outputs
LLM05 Improper Output HandlingValidate and encode outputs before use
LLM06 Excessive AgencyLeast privilege for tools and agents

How Do You Detect and Respond?

Log email events, identity sign-ins, payment approvals and AI tool calls in one place, and keep them for 180 days as CERT-In requires. Rehearse a deepfake payment fraud scenario. Report qualifying incidents to CERT-In within six hours, and victims of fraud in India should call 1930. Security testing of these controls needs written authorisation under Sections 43 and 66 of the IT Act 2000. Related: social engineering attacks and prevention and Chaos GPT and malicious AI. WebAsha offers ethical hacking and SOC training.

Review the matrix at least once a year. New AI capabilities appear quickly, but most still fit one of these six techniques. When a new threat is reported, ask which row it belongs to, whether your prevent and detect controls still work, and who owns the gap. This keeps the programme focused on controls you can test rather than on headlines about new tools.

References

Frequently Asked Questions

Mostly AI-written phishing, voice and video impersonation, synthetic identities, coding help, and attacks on company AI applications.

Use call-back verification on known numbers and two-person approval for payments, so even a perfect fake cannot move money.

A fake identity built from generated photos, documents and sometimes real stolen details, used to open accounts or take loans.

Treat external content as untrusted, give AI tools least privilege, and require human approval before sensitive actions.

An OWASP LLM risk where an AI agent has more permissions or autonomy than it needs, so misuse causes greater damage.

It stops stolen passwords and codes from being reused on fake sites, which defeats most credential phishing however well written.

AI helps detect anomalies, but strong processes and identity controls matter more because detection of fakes is unreliable.

Organisations report qualifying incidents to CERT-In within six hours; individuals report fraud on 1930 and cybercrime.gov.in.

What's Your Reaction?

Like Like 0
Dislike Dislike 0
Love Love 0
Funny Funny 0
Wow Wow 0
Sad Sad 0
Angry Angry 0
Vaishnavi

Vaishnavi is a skilled tech professional at the Ethical Hacking Training Institute in Pune, responsible for managing and optimizing the technical infrastructure that supports advanced cybersecurity education. With deep expertise in network security, backend operations, and system performance, she ensures that practical labs, online modules, and assessments run smoothly and securely. Her behind-the-scenes contributions play a vital role in delivering a seamless and secure learning experience for aspiring ethical hackers.