Live career-page scraping
Every search visits the live career page of each selected company at the moment the search runs. There is no cached layer serving old data, so the result is a faithful snapshot of what the company is posting right now.
- Static HTML parsed with Cheerio — fast and low-overhead
- JavaScript-rendered pages driven by headless Chromium through a shared browser pool, so React, Angular and Vue career sites load fully before extraction
- ATS-embedded feeds handled by dedicated parsers rather than guessed at
- Anti-bot detection and bypass for Cloudflare managed challenges, AWS WAF, Incapsula, Akamai and PerimeterX, falling back to stealth-browser mode
- Sites that stay unresolvable — interactive captchas, Turnstile — are flagged career_blocked rather than silently returning zero