difend.net

AI agents at work: six security risks to know first

AI agents can now read your email, search your files and take actions on your behalf. That's useful, and it also creates new ways for attackers to get in. Before connecting an AI tool to business systems, understand where the risks sit.

Where AI agents can be attacked UserTypes a requestAI agentLanguage modelDecides what to doToolsEmail, filesMemoryPast chatsActionsSends, deletes, paysYour dataDocs, CRM, DBOutputReplies, changes1234561 Prompt injection 2 Poisoned model 3 Malicious tools4 Memory poisoning 5 Data leakage 6 Unchecked actions
Where AI agents can be attacked

The six risks

  1. Prompt injection. Hidden instructions in an email or web page trick the agent into doing something you didn't ask for, such as forwarding files.
  2. Poisoned models. A model trained or fine-tuned on manipulated data behaves badly in specific situations.
  3. Malicious tools and plug-ins. A third-party add-on with too many permissions can read or change data it shouldn't.
  4. Memory poisoning. False information planted in the agent's memory influences future answers.
  5. Data leakage. The agent reveals confidential information in its replies, or sends it to an outside service.
  6. Unchecked actions. The agent sends, deletes or pays without a person approving it.

Sensible first steps

  • Give AI tools the least access they need, and never admin rights.
  • Require a person to approve anything that sends, deletes or pays.
  • Use business AI plans that don't train on your data, and check where data is stored.
  • Add AI tools to your vendor review and acceptable use policy.

Thinking about AI tools for your team? Book a call and we'll help you adopt them safely.

Want help with this?

Book a 30-minute call and we'll look at your setup.

Book a consultation