SearchlarkBot

SearchlarkBot reads public pages on websites whose owners have connected them to Searchlark. It learns what the business offers so it can plan and link articles for that site, and it checks that links in drafts point to real pages.

How it behaves

• It follows robots.txt, including rules and crawl delays for the SearchlarkBot user agent.
• It reads a small number of pages per visit and waits between requests.
• It never submits forms, signs in, or reads pages behind a login.

Blocking it

Add this to your robots.txt:

User-agent: SearchlarkBot
Disallow: /