Crawler information

SparkCareersBot

SparkCareersBot is the web crawler operated by RisePoint Careers Corp. It visits publicly accessible careers pages so that job openings can be listed on our platform and found by jobseekers.

If you would rather we did not visit your site, add three lines to your robots.txt and we will stop on our next visit. The exact snippet is in How to block us below. No email required, though we are happy to hear from you.

Identifying the crawler

Our requests carry this user-agent string:

SparkCareersBot/1.0 (+https://risepointcareers.com/bot)

If you want to confirm that particular traffic is genuinely ours, see Verifying a visit. We do not disguise our crawler, rotate user-agent strings, or attempt to bypass bot protection.

What it collects

Only information a company publishes for the express purpose of attracting applicants — the same content any visitor sees on a public careers page:

We do not collect personal data, we do not attempt to reach pages behind a login, and we do not submit forms or applications.

Applications are never captured by us. Every listing links back to your own application process.

How it behaves

BehaviourWhat we do
robots.txt Fetched and honoured before any page request, using longest-match rules. Crawl-delay is respected where set.
Request rate At most one request per second to any single site, and slower if your Crawl-delay asks for it. Typically far below that in practice.
Visit frequency Careers pages are re-checked periodically rather than continuously. Unchanged pages are detected with conditional requests (If-None-Match), so most visits transfer no page content at all.
Scope Careers and job pages only. We do not crawl your whole site.
Errors A site that returns errors or rate-limits us is backed off and retried later, never hammered.

How to block us

Add this to your robots.txt:

User-agent: SparkCareersBot
Disallow: /

Or allow only part of your site

User-agent: SparkCareersBot
Allow: /careers/
Disallow: /

Or just slow us down

User-agent: SparkCareersBot
Crawl-delay: 10

Changes take effect on our next visit — normally within 24 hours, since we re-read robots.txt regularly rather than caching it indefinitely. If you need us to stop immediately, email us and we will add the block on our side.

Already blocked us and still seeing traffic? Please get in touch. Either something is wrong on our side and we want to fix it, or someone else is using our name — both are worth knowing about.

Verifying a visit

Anyone can put our name in a user-agent string, so the name alone proves nothing. Here is how to check properly.

Not available yet. The DNS records the check below relies on are not published, so it will fail today. We are setting this up and will publish it as soon as we can, and this page will say so when it is live.

Until then, send us the date and time (with timezone), the requesting IP and the user-agent from your logs, and we will confirm or deny that the traffic was ours. A request to stop crawling does not need to wait for any of this, and is actioned on receipt.

How the check will work

The same two-step method used to verify Googlebot. It needs no list of addresses from us, so it stays correct even when our infrastructure changes.

Step 1 — reverse lookup. Ask what hostname the IP claims:

host 203.0.113.10
10.113.0.203.in-addr.arpa domain name pointer crawl01.risepointcareers.com.

The answer must end in .risepointcareers.com. If it does not, the request is not ours.

Step 2 — forward lookup. Confirm that hostname points back:

host crawl01.risepointcareers.com
crawl01.risepointcareers.com has address 203.0.113.10

The address returned must be the same one that hit your server. If both steps agree, the request genuinely came from us.

Checking only step 1 is not enough: the reverse record alone can be set by whoever holds the IP. Passing both requires control of our domain's DNS, which is what makes the result trustworthy. The addresses shown above are illustrative, not ours.

If a request claims to be SparkCareersBot and fails these checks, it is not us and we would like to hear about it.

Why we do this

Most job search platforms concentrate on a small number of large markets and a narrow band of industries. RisePoint Careers exists to make openings discoverable more evenly across countries and sectors, including places where jobseekers are poorly served today.

Listing your roles costs you nothing and sends applicants to your own application process. If you would prefer to supply your openings directly rather than have us read them from your site, we would welcome that — a feed is easier for both of us than a crawl.

Contact

Questions, complaints, or requests to stop crawling:
support@risepointcareers.com

We read this mailbox and reply. A request to stop is actioned on receipt — you do not need to justify it.

RisePoint Careers Corp SparkCareersBot/1.0