Automation Engineer

Responsibilities

• Create crawlers for source URLs using Python modules including Scrapy, Selenium, Requests, BeautifulSoup, and Splash
• Maintain Scrapy pipelines and middlewares to manage crawler output
• Develop crawlers capable of overcoming technical roadblocks like IP bans, geolocation bans, and captchas
• Write SQL queries to manage database operations using SQLAlchemy
• Deploy Python scripts and crawlers to Linux-based AWS servers

Requirements

• Strong hands-on experience in Python programming
• Proficiency with scraping libraries: Requests, BeautifulSoup, Selenium, and Scrapy
• 3+ years of experience with web frameworks such as Flask, Django, FastAPI, Tornado, or Pandas
• Strong SQL knowledge and experience with RDBMS
• Proficiency with Git version control
• Understanding of REST APIs, JavaScript, HTML5, and CSS3
• Solid grasp of Object-Oriented Programming (OOP) concepts

Preferred Qualifications

• Experience with UI frameworks like Angular or ReactJS
• Knowledge of data engineering platforms such as Airflow
• Experience with Google Cloud, Docker, Celery, or ETL processes
• Familiarity with Agile/Scrum methodologies and Jira/Confluence

About the Company

Invisible Technologies offers unusual services, combining outsourcing and automation, to fast-scaling, innovative companies.