Web Automation Engineer

San Francisco HQ; Toronto Hub, Remote. Posted a month ago

The role

You will research and reverse engineer web detection systems to build resilient scraping infrastructure. This role involves identifying browser and network signals to maintain high scrape success rates at web scale.

What you will do

Research how modern websites detect and challenge automated traffic
Identify browser, device, network, and behavioral signals
Reproduce signals synthetically in authorized test environments
Build automation, diagnostic, and monitoring tools
Measure and explain scrape success rate regressions
Work with platform engineers to roll improvements out across the crawling fleet

Required qualifications

3+ years building browser automation, web infrastructure, or systems-level software
Strong JavaScript/TypeScript and/or Python
Real understanding of rendering, JS engines, and headless automation (CDP, Playwright, Puppeteer)
Solid grasp of HTTP/TLS, proxies, and browser and device fingerprinting
Ability to read minified, obfuscated code
Research with a shipping habit

Nice to have

Deobfuscating JavaScript and VM-based obfuscation
Network-level fingerprinting (TLS/HTTP2 signatures, JA3/JA4)
Running large browser or proxy fleets in production
Prior work at a scraping, web data, security research, or automation company

Benefits

Competitive equity
15 days mandatory PTO
12 weeks fully paid parental leave
$100 USD/month wellness stipend
$1,000 USD/year Learning & Development expense
Team offsites
3 paid months sabbatical after 4 years
Medical, dental, and vision coverage
Life and Disability insurance
Virtual care and health guide
Mental health support
Fertility and family building

Before you apply

Open to candidates already authorized to work in the US or Canada
In the US, supports H-1B transfers, F-1 OPT and STEM OPT, TN, and E-3
In Canada, work permit sponsorship considered case by case
Includes a 40-hour paid work trial

About the company

Firecrawl is an AI infrastructure company that converts the web into data for AI agents. They provide an API that converts URLs into clean, LLM-ready markdown or structured data.