chainofsalebot

chainofsale's crawler reads the files sellers and buyers of advertising publish for machines, and nothing else on a site. From them chainofsale shows an Ad system every domain whose ads.txt does not confirm one of its Sellers, with the line that fixes it. Its User-Agent names it, its version and this page:

chainofsalebot/<version> (+https://chainofsale.com/crawler/)

What it reads

Every site it reads from, first

/robots.txt

An Ad system's

/sellers.json

Each of its Sellers' domains

/ads.txt, /app-ads.txt, /.well-known/adagents.json

A Manager or an inventory partner the domain names

/.well-known/adagents.json, /ads.txt

It reads each file at most once a day, however many Ad systems name the domain, and reads about 32 sites at a time, so a site sees only its own few requests.

Letting it in, or keeping it out

It obeys robots.txt (RFC 9309): the group for chainofsalebot if there is one, otherwise the group for every crawler. A robots.txt that keeps everyone out keeps it out too; this group lets it read the files it checks:

User-agent: chainofsalebotAllow: /ads.txtAllow: /app-ads.txtAllow: /.well-known/adagents.jsonAllow: /sellers.json

A file it may not read, by robots.txt or by bot protection, leaves every Seller on the domain unchecked: the Ad system's report shows the file as Blocked, and asks whoever hosts it to let chainofsalebot in. When robots.txt answers with a server error, or not at all, it reads nothing else on the site until it asks again. To keep it out:

User-agent: chainofsalebotDisallow: /

Checking it is ours

It reads from one address, whose reverse DNS names it, and that name points back to the address:

Address

159.69.150.110

Reverse DNS

crawler.chainofsale.com

host 159.69.150.110host crawler.chainofsale.com

Writing to us

About the crawler: crawler@chainofsale.com. To report abuse: abuse@chainofsale.com.