CabanaBot
CabanaBot is the crawler for Cabana Engine, an SEO service. It reads public web pages so their owners can see how to improve them.
How to recognise it
Mozilla/5.0 (compatible; CabanaBot/1.0; +https://cabana.africa/engine/bot)The robots.txt token is CabanaBot.
When it visits
- Sites whose owners connected them to Cabana Engine and proved ownership, about once a week on free plans and daily on paid plans, plus when the owner asks.
- A few pages of sites that rank for an Engine customer’s keywords, to compare them like for like.
- A single page when someone uses the free check on our home page.
It reads HTML, robots.txt and sitemaps only. It never submits forms, signs in, or downloads large files, and it reads at most six pages of a site at a time.
Controlling it
CabanaBot obeys robots.txt rules for CabanaBot, then for *. To keep it out entirely:
User-agent: CabanaBot
Disallow: /Questions or problems: engine@cabana.africa.