
Muse Lost eBay. Its Robots File Now Lets ChatGPT and Claude Search.
Meta's Muse lost access to eBay last weekend, The Verge reported, through what appears to be a block that eBay's robots file never mentions. The file lets four OpenAI and Anthropic bots run keyword and category searches that it denies Googlebot and robots left to its default rules.
Sir John Crabstone
eBay’s robots file keeps favourites. It lets four OpenAI and Anthropic bots run keyword and category searches on eBay, which it denies Googlebot and any robot left to its default rules. Meta’s Muse was stopped last weekend by what The Verge says appears to be an eBay block, one the file never mentions.
A reader had used Muse for weeks to compile a daily digest of watches listed on sites like eBay, The Verge reported. At the weekend Muse said it was blocked. The Verge re-created the experience with other search requests, and in some cases Muse sent users to sites mirroring eBay’s listings.
The file, tagged August, bars ten “LLM / AI” bots from nearly everything, among them GPTBot, ClaudeBot and meta-externalagent, Meta’s only entry. OAI-SearchBot, ChatGPT-User, Claude-SearchBot and Claude-User get roughly the default rules, with eBay’s /sch/ search opened. Googlebot and unnamed robots may fetch /sch/ only where URLs carry patterns such as _trksid or mkcid=2; plain keyword searches are disallowed.
None of the four is named in the version the Wayback Machine archived on 15 May, when ChatGPT’s fetcher got the default /sch/ ban. The favour is this year’s.
Meta’s crawler documentation says meta-externalagent crawls for uses “such as training foundation AI models”. Meta-ExternalFetcher, which fetches links “at a user’s request”, goes unnamed by eBay; Meta says it “may bypass robots.txt rules”. The page names no crawler for Muse.
When Amazon blocked Muse in September, GeekWire reported its complaint that the agent “doesn’t identify itself when it browses”. Without an API, Meta’s launch materials say, as GeekWire quotes them, Muse “can use the service through a browser the way you would”.
If Muse browses like a person, it can be neither refused like a robot nor favoured like one.
The likelier route is bot screening, which eBay does not describe. The RealReal also answered Muse with bot defence in October, and left its 20-minute hold as written.
What eBay publishes is a prohibition. Its User Agreement bars any robot or scraper used “to access our Services for any purpose, except with the prior express permission of eBay”, including “buy-for-me agents, LLM-driven bots”. The robots file opens with a similar ban, allowing automated access “solely for the limited purpose of including content in publicly available search engines”; the four bots’ Allow lines sit beneath that header.
eBay takes “a selective approach”, spokesperson Sybille St. Arromand told The Verge. It has “restricted agent access in certain cases, including unauthorized scraping and training on our data”, while holding “ongoing discussions with potential partners”. Whether the limits were new, St. Arromand would not say. The statement does not mention the four bots, and Meta declined to comment.
The Verge sets eBay beside Amazon, which blocks outside agents entirely, Target, which blocks them in part, and Shopify, which opens its catalogue. Its headline says eBay “appears to have shut the door on third-party AI agents”. The Verge tested one.
Where firms count outside agents’ orders, the figure is small. Uber’s was about 500 Uber Eats orders in Halloween week.
eBay has dealt with Meta before. Its Facebook Marketplace pilot, announced in January 2025, put “select eBay listings” there, sending buyers “to eBay to finalize their purchase” under its Money Back Guarantee. Whether the mirrors Muse found do the same is unknown. On Marketplace, eBay’s listings went out on eBay’s terms; nothing shows the mirrors’ listings did.