Skip to content
← Back to job listings

Senior Anti-Bot / Scraping Engineer

Adthena · London, United Kingdom

RemoteImported listingfull-time2 days ago

About The Role

Join Adthena, a leading provider of AI-powered search intelligence. As a Senior Anti-Bot Engineer, you will design, build, and operate large-scale web scraping systems, focusing on Google and similar search environments. You will work on complex scraping problems, engineer robust extraction pipelines, and collaborate with data engineers, data scientists, and product teams. Enjoy a range of benefits, including flexible working, stock options, and comprehensive medical insurance.

  • Design, build, and operate large-scale, resilient web scraping systems, with a strong focus on Google and Google-like search environments.
  • Continuously adapt to changes in page structure, request flows, and anti-automation mechanisms, and engineer robust extraction pipelines.
  • Monitor scrape health, detect failures early, and rapidly debug production issues, while optimizing performance, cost, and latency across scraping infrastructure.
  • Strong professional experience with Python (or another main language, i.e. GoLang, Rust, JavaScript) including production-grade scraping systems
  • Deep hands-on experience scraping Google or similarly protected platforms
  • Experience running scrapers at scale in cloud environments
  • Strong knowledge of HTML parsing, DOM traversal, and data extraction techniques
  • Solid understanding of HTTP, TLS, cookies, headers, redirects, and browser networking behaviour
  • Experience with tools such as Playwright, Selenium, Puppeteer, or equivalent browser automation frameworks
  • Experience with headless browser fingerprinting and anti-bot evasion techniques
  • Strong debugging skills and ability to reason about complex failure modes
  • Experience handling rate limiting, CAPTCHA, IP rotation, and bot detection systems
  • Comfortable working with asynchronous and concurrent scraping architectures
  • Pragmatic problem-solving in hostile and fast-changing technical environments
  • High ownership of systems that run continuously and at scale
  • Ability to explain complex technical behaviour clearly to non-specialists
  • Curiosity about how large platforms evolve their defences and infrastructure
  • A strong bias toward reliability, correctness, and observability
  • Familiarity with containerisation and orchestration, such as Docker and Kubernetes
  • Experience with distributed task systems and job queues
  • Background in data quality monitoring and anomaly detection
  • Experience working with search, advertising, or competitive intelligence data

This is an external listing. JobSpring does not represent or verify the employer. Report this listing