BOT

FinInternsBot

FinInternsBot is the automated crawler that gathers the internship postings shown on FinInterns. It sends the User-Agent header FinInternsBot/1.0 (+https://fininterns.com/bot) so operators can identify it in their access logs.

How often it runs

Twice daily, plus a weekly full pass. Each run finishes in under 10 minutes for any single employer.

What it fetches

Only the public careers pages and job-board endpoints already exposed by each employer’s ATS provider (Greenhouse, Lever, Ashby, Workday, SmartRecruiters, iCIMS, SuccessFactors, Oracle HCM). It authenticates to nothing, honors robots.txt, and rate-limits to one request per second per host.

What it stores

Job titles, apply URLs, locations, and the tags we derive from those. Job descriptions are read for classification and discarded immediately; they are never saved to our database or logs.

Contact

For questions or to request that we stop fetching your careers pages, email support@fininterns.com. Removal requests are honored within 48 hours; see the takedown page for details.