Senior Software Engineer - Crawler

Responsibilities

• Design and implement components of scalable, fault-tolerant web crawling and extraction pipelines
• Write clean, production-grade code in Java and Python
• Build and operate ETL/ELT pipelines for large-scale data extraction and transformation
• Work with cloud infrastructure on GCP and AWS, primarily on GKE
• Improve observability, reliability, and operational excellence across systems
• Partner with product and data science teams to deliver impactful solutions
• Contribute to code reviews, documentation, and knowledge sharing

Requirements

• 5+ years of professional software engineering experience building production systems
• Strong CS fundamentals in algorithms, data structures, concurrency, and distributed systems
• Proficiency in Java and/or Python
• Hands-on experience with cloud data warehouses like BigQuery or Snowflake
• Experience designing and operating large-scale ETL/ELT pipelines
• Experience with orchestration tools such as Apache Airflow
• Experience with streaming or event-driven systems such as Apache Kafka
• Production experience on GCP or AWS
• Hands-on experience with Kubernetes (GKE/EKS)
• Familiarity with infrastructure-as-code tooling such as Terraform

Preferred Qualifications

• Experience with web crawling at scale using Scrapy or similar frameworks
• Familiarity with proxy infrastructure and anti-bot evasion techniques
• Knowledge of SERP extraction
• Comfort with AI/LLM-based extraction approaches applied to HTML at scale
• Experience working in a B2B data company or data-as-a-product environment

About the Company

ZoomInfo is the Go-To-Market Intelligence Platform that empowers businesses to grow faster with AI-ready insights, trusted data, and advanced automation.