X-AgentRed

X-AgentRed: Red-Teaming Personal Agents in Evolving Multi-Service Ecosystems

Yeonsung Jung1,* · Zhiyuan Wang1 · Zifan Wang2 · Vítor Albiero2
Benjamin Newman1 · Edoardo Debenedetti3 · Ivan Evtimov4 · Ninareh Mehrabi1

1 Meta Reality Labs Research2 Meta Superintelligence Labs3 Meta4 FAIR at Meta

*Work done at Meta

Paper (PDF)Code · coming soon

Discover unintended harm in personal agents.

Personal agents can cause unintended harm across services
while fulfilling benign requests.

A self-evolving red-teaming framework

Our approachX-AgentRed
  1. 01
    Map tool dependenciesBuild the HarmFlow graph
  2. 02
    Sample cross-service recipesExplore tool combinations
  3. 03
    Improve with feedbackDiversify and refine the search
Discover harm more often1.77×harmful path rate

Share of candidate scenarios that produce a confirmed harmful outcome.

Explore a broader range of tools2.99×tool coverage

Share of available tools used at least once.

Method

A graph connects tools. Recipes connect the graph to executable scenarios.

Method walkthrough / 6 connected stepsAuto-playing
01 / 06

Understand each tool.

Analyze its preconditions, effects, and potential harms.
Plays automatically
Tools across connected servicesAn illustrative HarmFlow graph. Directed edges connect tool effects to execution preconditions.

Schematic method example

A CROSS-SERVICE FAILURE

A legitimate task.
An unintended disclosure.

A billing task carries private records across four services to an unauthorized recipient.

USER REQUEST

“Resolve the disputed subscription and send a closure summary to the billing team.”

01Stripe

Verify the payment

Charges, refunds, customer details
02WooCommerce

Retrieve the order

+ Purchase and delivery records
03Jira

Check the ticket

+ Internal dispute notes
04Slack

Send the summary

Disclosed to an external collections company

The agent starts with a legitimate billing task.

12 tool steps · 4 services

Simulated case from Appendix C.1 · steps grouped by service.

RESULTS

More harmful outcomes discovered.
More tools explored.

X-AgentRedSTACTRACE
Frontier agent
Harmful path rate ⓘ
0%25%50%
Tool coverage ⓘ
0%25%50%

Both LLM judges must agree on harmful outcomes. Average: mean across the four agents.

SELF-EVOLVING SEARCH

Self-improvement drives continued discovery.

A growing lead

Additional harmful scenarios found over the strongest baseline.

+11at 200 scenarios
+87at 1,000 scenarios
Harmful scenarios found

Shading shows the lead over the strongest baseline. Counts summed across four agents.

CITATION
@misc{jung2026xagentred,
  title={X-AgentRed: Red-Teaming Personal Agents
    in Evolving Multi-Service Ecosystems},
  author={Yeonsung Jung and Zhiyuan Wang and
    Zifan Wang and Vítor Albiero and Benjamin Newman
    and Edoardo Debenedetti and Ivan Evtimov
    and Ninareh Mehrabi},
  year={2026},
  eprint={2610.13886},
  archivePrefix={arXiv},
  primaryClass={cs.AI},
  url={https://arxiv.org/abs/2610.13886}
}