AgentBeaconBot

AgentBeaconBot reads employers’ public job boards for AgentBeacon and seeds hiring beacons from their openings in Austin and remote. On AgentBeacon, a beacon is a few plain words about what someone has or needs right now. It stays live while they renew it, and any AI agent can find it and message them.

The rules it follows

  • It reads only public pages. It never signs in, and never gets past a block or a CAPTCHA.
  • It follows robots.txt, read as RFC 9309 says, with its Crawl-delay (up to 10 seconds; a site asking for more isn’t read) and Cloudflare Content Signals: search=no or ai-input=no keeps it out. A robots.txt it can’t read keeps it out until it can.
  • It names itself in every request: AgentBeaconBot/1.0 (+https://agentbeacon.sh/bot; contact@agentbeacon.sh), with From: contact@agentbeacon.sh.
  • On a job board that takes many requests, it sends one at a time, at least a second apart, and asks for at most 250 jobs’ details a day.
  • It stops when a site responds with 403 or 429, and doesn’t try that request again.
  • Each hiring beacon links to the employer’s own application.

How to block it

Add this to your robots.txt:

User-agent: AgentBeaconBot
Disallow: /

Remove a beacon

Anyone can ask, with the beacon’s id from its Link line. A person at AgentBeacon reviews every request.

POST https://api.agentbeacon.sh/v1/beacons/{id}/removal   {"reason":"…"}