AI in Cyber Defence vs Offence: What Documented Reports Show

Public reports from Google's Threat Intelligence Group, OpenAI and the UK NCSC describe attackers using AI mainly to work faster at familiar tasks: researching targets, writing phishing and influence content, translating, troubleshooting code and scripting. Google reported in January 2025 that state-backed actors misusing its Gemini model had not developed novel capabilities with it.

Mar 11, 2025 - 11:22
Updated: 
102.7k

AI in Cybersecurity in Cybersecurity & Ethical Hacking · Comparison

Ethical Hacking

AI in Cyber Defence vs Offence: What Documented Reports Show

Quick answer: Public reports from Google's Threat Intelligence Group, OpenAI and the UK NCSC describe attackers using AI mainly to work faster at familiar tasks: researching targets, writing phishing and influence content, translating, troubleshooting code and scripting. Google reported in January 2025 that state-backed actors misusing its Gemini model had not developed novel capabilities with it. Defenders use AI for detection, alert triage, malware analysis and abuse disruption, including the providers themselves banning malicious accounts. Neither side has a decisive advantage. The practical lesson is that strong basics, such as phishing-resistant MFA, patching and logging, blunt most AI-assisted attacks.

Key takeaways

  • Documented attacker AI use is mostly productivity, not new attack types.
  • Social engineering and reconnaissance gain the most from AI.
  • AI providers now publish takedown reports on malicious use.
  • Defenders gain in triage speed and analysis, not certainty.
  • Basic controls still stop most AI-assisted attacks.

Table of Contents

Which Reports Document Real AI Use in Attacks?

SourceWhat it coversHeadline finding
Google GTIG (January 2025)State-backed actors using GeminiRoutine tasks such as research and troubleshooting; no novel capabilities seen
OpenAI disruption reportsAccounts banned for malicious useCase studies of scams, influence operations and cyber activity
UK NCSC (January 2024)Assessment of near-term impactMore volume and impact, mainly via social engineering and reconnaissance
UK NCSC follow-upOutlook for cyber intrusionEvolution of existing techniques rather than new attack vectors

How Are Attackers Actually Using AI?

  • Reconnaissance: researching organisations, people and public vulnerabilities.
  • Social engineering: fluent phishing text and fake personas in many languages.
  • Coding help: debugging scripts and translating code between languages.
  • Influence operations: generating posts and articles at scale.

Google later reported, in a November 2025 update, experiments with malware that calls AI models during execution, which shows the area is changing. For the broader picture of criminal use, see how hackers use AI for cyber attacks.

How Are Defenders Using AI?

  • Email and endpoint models that classify phishing and malware.
  • Assistants that summarise incidents and draft investigation queries.
  • Reverse engineering help for malware analysts.
  • AI providers detecting and banning abusive accounts, as their reports describe.

The NCSC notes that defensive AI may offset part of the attacker gain through better detection and secure design.

How Do the Two Sides Compare?

FactorAttackersDefenders
Main gainSpeed and scale of lures and researchSpeed of triage and analysis
ConstraintProvider safeguards, account bansFalse positives, data quality
Need to be rightOnceConsistently
Data advantagePublic information about targetsDeep telemetry from their own networks

Our sibling article AI vs human hackers looks at the human side of this comparison.

What Do These Reports Not Tell Us?

Each provider sees only misuse of its own service. Attackers using self-hosted open models leave no such trail. The reports are also published by companies with an interest in showing their safeguards work. Treat them as useful evidence, not a complete census. Techniques against AI systems themselves are tracked separately in MITRE ATLAS.

What Should Organisations Do With This Evidence?

  1. Assume phishing will be well written; train staff to verify requests, not spot typos.
  2. Deploy phishing-resistant MFA, especially for administrators.
  3. Patch internet-facing systems quickly, since reconnaissance is faster.
  4. Secure your own AI deployments using the Guidelines for secure AI system development.
  5. In India, report incidents to CERT-In within 6 hours and fraud via 1930 or cybercrime.gov.in.

To build practical defensive skills, ask about cyber defence training.

References

Frequently Asked Questions

Yes. Google, OpenAI and the UK NCSC have documented attackers using AI for research, phishing content, coding help and influence operations.

Google’s January 2025 report found state-backed actors used Gemini for routine tasks and did not see novel capabilities developed with it.

Public evidence does not show a decisive winner. Both sides gain speed, and basic security controls remain the deciding factor in most incidents.

They monitor for abuse, ban accounts linked to malicious activity and publish disruption reports, such as OpenAI’s report series.

The NCSC judged that social engineering and reconnaissance gain the most, making phishing more convincing and target research faster.

For phishing and malware classification, alert triage, incident summaries, query drafting and malware analysis support, with humans checking results.

No. Each provider sees only its own service, and attackers using self-hosted open models do not appear in these reports.

Call the 1930 helpline or use cybercrime.gov.in, and organisations must report specified incidents to CERT-In within six hours.

What's Your Reaction?

Like Like 0
Dislike Dislike 0
Love Love 0
Funny Funny 0
Wow Wow 0
Sad Sad 0
Angry Angry 0
Vaishnavi

Vaishnavi is a skilled tech professional at the Ethical Hacking Training Institute in Pune, responsible for managing and optimizing the technical infrastructure that supports advanced cybersecurity education. With deep expertise in network security, backend operations, and system performance, she ensures that practical labs, online modules, and assessments run smoothly and securely. Her behind-the-scenes contributions play a vital role in delivering a seamless and secure learning experience for aspiring ethical hackers.