Backend Infrastructure Engineer, Anti-Bot

Role details

ABOUT THE ROLE Join a team building the infrastructure behind a web data extraction platform for AI applications. You will own production systems that keep extraction fast and reliable against websites using sophisticated automated-access defenses. WHAT YOU'LL DO - Architect and operate proxy rotation, IP and session management, and isolated egress infrastructure at scale. - Improve extraction success rates against websites that actively block automated access. - Build and maintain browser and TLS fingerprint management, CAPTCHA handling, and challenge-solving systems. - Monitor proxy-layer reliability and cost efficiency, and manage its operating economics. - Diagnose intermittent failures across the stack, implement durable fixes, and support systems in production. WHAT WE'RE LOOKING FOR - More than 3 years of experience in adversarial web infrastructure, proxy-layer engineering, or web data extraction, with recent hands-on work in this area. - Production experience architecting proxy rotation, IP and session management, egress isolation, and proxy economics for third-party web extraction. - Experience bypassing major anti-bot defenses, such as Akamai, DataDome, Cloudflare, or Kasada, and owning extraction success-rate metrics. - Production experience with browser and TLS fingerprinting, CAPTCHA or challenge handling, and high-volume extraction against adversarial defenses. - Proficiency in Go and/or Python, plus strong networking fundamentals including TCP/IP, HTTP/2, connection pooling, and proxy orchestration. - Experience owning production systems end to end, including on-call, observability, and tools such as Prometheus and Grafana. COMPENSATION & BENEFITS Base salary: $235,000 to $260,000 USD annually. Visa sponsorship is available. LOCATION Hybrid role based in San Francisco, California, United States.