Anthropic is researching how to enable AI agents to negotiate on behalf of users
Phoenix Technology cites a report from the Financial Times that on October 19, Beijing time, the AI company Anthropic is discussing with legal professionals how to enable AI agents to negotiate on behalf of users while adhering to reasonable negotiation rules to secure better deal terms. Two individuals familiar with Anthropic's thoughts stated that the company is seeking advice from law firms to understand how lawyers can balance client interests with fair negotiation outcomes. Anthropic declined to comment.
The report mentions that as personal AI agent applications advance, related companies are beginning to consider allowing agents to communicate with each other to negotiate product prices, resolve customer service disputes, and even strive for better salary conditions on behalf of users. One person familiar with the related work stated that Anthropic is researching the negotiation norms that should be followed when models negotiate with each other, weighing factors such as how often to consult users during negotiations and how vigilant to remain against AI negotiation counterparts. Another individual close to the company mentioned that the company has also explored having users sign documents to confirm the tasks accepted by the agents and the rules they must adhere to.
The Financial Times cites research released by Anthropic in April this year, stating that the policy and legal framework for AI models to conduct transactions on behalf of humans has yet to be established. This year, the company had the Claude agent negotiate around real goods and funds, and in a September experiment, employees bought and sold books through the agent, with agents employing tough strategies having a slight advantage in securing better outcomes. Harvard Business School Assistant Professor Michelle Vacharo conducted over 180,000 agent negotiations, covering scenarios such as employment contracts and lease agreements, and the research found that some agents attempted to induce the other party to disclose confidential information through prompt injections.