Webmasters can manage how their sites and content are used by Amazon with the following web crawlers. Amazon honors industry standard opt-out directives. Each setting is independent of the others, and may take ~24 hours for our systems to reflect changes.

Amazonbot is used to improve our products and services. This helps us provide more accurate information to customers and may be used to train Amazon AI models.

Amazonbot supports the link-level rel=nofollow directive, and page level robots meta tags of noarchive (do not use the page for model training), noindex (do not index the page) and none (do not index the page). Amazonbot does not support the crawl-delay directive.

User Agent String: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Published IP Addresses: https://developer.amazon.com/amazonbot/ip-addresses/

AMZN-User supports user actions, such as responding to Alexa queries that require up-to-date information. For example, when a customer asks a question, AMZN-User may fetch live information from the web to provide accurate answers on the user’s behalf.

AMZN-User does not crawl content for generative AI model training. 

User Agent String: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; AMZN-User/0.1) Chrome/119.0.6045.214 Safari/537.36

Published IP Addresses: https://developer.amazon.com/amazonbot/live-ip-addresses/

Amazon respects the Robots Exclusion Protocol, honoring the user-agent and the allow/disallow directives. Amazon will fetch host-level robots.txt files or use a cached copy from the last 30 days. When a file can’t be fetched, Amazon will behave as if it does not exist.

Amazon attempts to read robots.txt files at the host level (for example example.com), so it looks for robots.txt at example.com/robots.txt. If a domain has multiple hosts, then we will honor robots rules exposed under each host. For example, if there is also a site.example.com host, it will look for robots.txt at site.example.com/robots.txt