SynapsMedia-MarketBot
The crawler behind a monthly market report on the Ghost publishing platform by Synaps Media, with the first issue in December 2026.
What it does
It looks at publicly listed websites (Ghost's own Explore directory, the social web, sites' recommendations) to tell which ones run Ghost, on which version, and where they are hosted. The monthly report only publishes totals and shares, never a list of sites.
How it visits
- Each site about once a week, with a handful of requests: the home page,
robots.txt, the RSS feed, Ghost's public APIs (the site endpoint, and the Content API with the public key the site puts in its own pages),/.well-known/files for the social web and recommendations, and a few of Ghost's static files. - Across all sites, about 30 sites a minute, one request at a time per site.
- It follows
robots.txtfor pages and feeds, under its own name or*. Ghost's public APIs and static files aren't pages, so a site that disallows everything is only asked Ghost's public site endpoint. - It never logs in, submits forms, or tries to get past a bot challenge.
How to recognise it
| User agent | SynapsMedia-MarketBot/1.0 (+https://market.bot.synapsmedia.com), with the header X-SynapsMedia-MarketBot: true |
|---|---|
| IP address | 5.75.219.149, reverse DNS market.bot.synapsmedia.com (which resolves back to the same address) |
| Signatures | Requests are signed with Web Bot Auth (HTTP Message Signatures). Signature-Agent points here, and the public key is at /.well-known/http-message-signatures-directory. |
Leaving it out
To keep it off your pages, add this to your robots.txt:
User-agent: SynapsMedia-MarketBot Disallow: /
Rules written for its earlier name, GhostMarketBot, are still followed.
To be left out entirely, write to support@synapsmedia.com with your domain and we'll stop visiting it.