Senior Python Scraping / Anti-Bot Engineer

Join Adthena, a leading provider of AI-powered search intelligence. As a Senior Python Scraping / Anti-Bot Engineer, you will design, build, and operate large-scale web scraping systems, focusing on Google and similar search environments. You will work on complex scraping problems, engineer robust extraction pipelines, and collaborate with data engineers, data scientists, and product teams. Enjoy benefits such as flexible working, stock options, and fully covered medical insurance.

• Design, build, and operate large-scale, resilient web scraping systems, with a strong focus on Google and Google-like search environments.
• Continuously adapt to changes in page structure, request flows, and anti-automation mechanisms, and engineer robust extraction pipelines.
• Monitor scrape health, detect failures early, and rapidly debug production issues, while optimizing performance, cost, and latency across scraping infrastructure.

• The role is ideal for someone who believes in agentic coding and would like to improve their skills
• Research shows men apply if they meet ~60% of the criteria, while women and underrepresented groups apply only if they meet all requirements. If you have the skills but don't meet every requirement, reach out – we'd love to explore how you could be a great fit!
• Comfortable working with asynchronous and concurrent scraping architectures
• Experience with tools such as Playwright, Selenium, Puppeteer, or equivalent browser automation frameworks
• Experience handling rate limiting, CAPTCHA, IP rotation, and bot detection systems
• Strong debugging skills and ability to reason about complex failure modes
• Strong professional experience with Python (or another main language, i.e. GoLang, Rust, JavaScript) including production-grade scraping systems
• Deep hands-on experience scraping Google or similarly protected platforms
• Strong knowledge of HTML parsing, DOM traversal, and data extraction techniques
• Solid understanding of HTTP, TLS, cookies, headers, redirects, and browser networking behaviour
• Experience with headless browser fingerprinting and anti-bot evasion techniques
• Experience running scrapers at scale in cloud environments
• Experience with distributed task systems and job queues
• Familiarity with containerisation and orchestration, such as Docker and Kubernetes
• Background in data quality monitoring and anomaly detection
• Experience working with search, advertising, or competitive intelligence data