SecurityMay 3, 20267 min read

How to Protect Yourself from AI-Generated Phishing

SC

By Sarah Chen

Head of Privacy Research

How to Protect Yourself from AI-Generated Phishing

Phishing emails used to be easy to spot. Awkward grammar, generic greetings, and obvious spelling mistakes were reliable red flags. That era is over. Criminals are now using generative AI tools like ChatGPT and other large language models to produce phishing emails that are virtually indistinguishable from legitimate business communications. Security researchers report a 1,265% increase in AI-driven phishing attacks since 2023, and studies show that AI-generated phishing emails achieve a 60% higher click rate than traditional ones. Here is what you need to know to protect yourself.

How AI Has Changed the Phishing Landscape

Traditional phishing relied on volume over quality. Attackers would blast millions of poorly written emails, hoping a small percentage of recipients would click. AI has flipped that equation. Attackers can now generate highly personalized, grammatically flawless phishing emails in about five minutes, compared to the sixteen hours a skilled human operator would need. That means criminals can run spear phishing campaigns at scale, targeting thousands of individuals with unique, customized messages for roughly the cost of a single traditional campaign.

The sophistication goes beyond just better writing. AI-powered tools can:

  • Scrape and analyze personal data: AI crawlers extract information from social media profiles, corporate websites, data broker databases, and past data breach dumps to build detailed profiles of targets
  • Generate context-aware messages: Using scraped data, AI crafts emails that reference your real name, job title, recent activities, colleagues, or even internal company jargon
  • Mimic writing styles: AI can analyze and replicate the writing patterns of a specific person, making spoofed emails from your boss or a colleague far more convincing
  • Create matching fake websites: In one security test, researchers used a single ChatGPT prompt to generate both a phishing email and a fully functional fake login page in under 20 seconds
  • Operate in any language: AI eliminates the language barrier that once made foreign phishing attempts easy to identify

The Data Broker Connection

AI phishing is most dangerous when attackers feed it personal information purchased from data brokers. Your full name, home address, employer, job title, family members, and phone number are often available on people-search sites for anyone to find. Attackers use this information to craft emails so personalized that even security-conscious individuals struggle to identify them as fraudulent. In one documented case, attackers scraped LinkedIn profiles of 47 employees at a healthcare organization and used AI to send personalized phishing emails that achieved a 38% click rate.

How to Spot AI-Generated Phishing Emails

Because AI-generated phishing no longer has obvious grammatical mistakes, you need to rely on different detection strategies:

Check the Sender Carefully

Examine the full email address, not just the display name. AI can write a perfect email, but attackers still need to send it from somewhere. Look for subtle misspellings in the domain (like "rnicrosoft.com" instead of "microsoft.com") or unfamiliar domains that do not match the organization supposedly contacting you.

Watch for Urgency and Pressure

AI-generated phishing often creates a false sense of urgency -- your account will be suspended, a payment is overdue, or you must verify your identity immediately. Legitimate organizations rarely demand immediate action through email alone.

Hover Before You Click

Before clicking any link, hover over it to see the actual URL. If the displayed text says one thing but the underlying link points somewhere else, that is a strong indicator of phishing. This remains one of the most reliable defenses regardless of how well the email is written.

Verify Through a Separate Channel

If an email asks you to take any action involving your credentials, money, or personal information, verify the request by contacting the supposed sender through a different channel. Call the company directly using a number from their official website, not from the email itself.

Be Suspicious of Personalization

This is counterintuitive, but it matters. If an email references specific personal details about you -- your job title, recent purchases, or the name of your manager -- do not assume it must be legitimate. That information may have been scraped from data brokers or social media. The more personalized an unexpected email is, the more cautious you should be.

Technical Defenses That Work

Beyond vigilance, there are concrete technical steps you can take to protect yourself:

Use FIDO2 Security Keys or Passkeys

Hardware security keys and passkeys are the single most effective defense against phishing, including AI-generated phishing. They verify the actual domain of the website you are logging into, so even if you click a phishing link and land on a perfect replica of your bank's login page, the security key will refuse to authenticate because the domain does not match. No amount of AI sophistication can bypass this.

Rely on Your Password Manager

Password managers autofill credentials only on the exact domain where they were saved. If you click a phishing link and your password manager does not offer to fill in your login, that is an immediate warning that you are on the wrong site.

Enable Multi-Factor Authentication Everywhere

While SMS-based two-factor authentication is better than nothing, app-based authenticators (like Google Authenticator or Authy) provide stronger protection. They add a layer that phishing emails alone cannot bypass.

Keep Software Updated

Phishing emails sometimes deliver malware through attachments or links that exploit software vulnerabilities. Keeping your operating system, browser, and email client updated ensures known vulnerabilities are patched.

Why Reducing Your Data Broker Footprint Matters

AI phishing is only as effective as the personal data that fuels it. When your information is available on data broker sites, attackers can craft emails that reference your real details, making them far more convincing. Removing your data from these sources does not just protect your privacy -- it directly degrades the quality of phishing attacks that can be launched against you. PrivacyOn automates the opt-out process across 100+ data broker sites and continuously monitors for your information reappearing, reducing the raw material that AI phishing tools depend on.

What to Do If You Fall for an AI Phishing Attack

Even careful people can be deceived by a well-crafted AI phishing email. If you suspect you have been compromised, act quickly:

  1. Change your passwords immediately: Start with the account that was targeted, then change passwords for any other accounts that share the same credentials
  2. Enable or update multi-factor authentication on all affected accounts
  3. Contact your bank or financial institutions if you entered any financial information or if the phishing email impersonated a financial service
  4. Report the phishing email to the organization that was impersonated, to your email provider, and to the FTC at reportfraud.ftc.gov
  5. Monitor your accounts and credit reports for unusual activity in the weeks and months following the incident
  6. Run a malware scan if you downloaded any attachments or installed any software prompted by the phishing email

The Bigger Picture

AI-generated phishing is not a future threat -- it is the present reality. According to KnowBe4's 2025 Phishing Threat Report, 82.6% of all phishing emails now contain AI-generated elements. The technology will only improve, making these attacks harder to detect through content analysis alone.

The most effective defense is layered. Use technical tools like passkeys and password managers that verify domains regardless of how convincing an email looks. Stay skeptical of any unsolicited communication that asks for action, especially when it feels urgent or unusually personalized. And reduce the personal data available about you online -- services like PrivacyOn that remove your information from data brokers and include dark web monitoring make it significantly harder for attackers to build the detailed profiles that power AI-driven spear phishing.

The attackers have upgraded their tools. It is time to upgrade your defenses.

SC
Sarah Chen

Head of Privacy Research

CIPP/US CertifiedIAPP MemberB.S. Computer Science

CIPP/US-certified privacy researcher with over a decade of experience helping consumers remove their personal information from data brokers.

Ready to Protect Your Privacy?

Let PrivacyOn automatically remove your personal information from data broker sites and keep it removed.