Python Developer — Web Automation & Data Extraction

Role Overview

Vortexen Dynamics Industrial Solutions is an engineering and industrial solutions company. We are currently developing an internal technology platform focused on automated web research, data collection, and structured company information. We are looking for a Python Developer — Web Automation & Data Extraction to work on the development of our web crawling and data extraction systems.

Responsibilities

• Develop and maintain Python-based web automation and data extraction solutions.
• Build and improve web crawlers, spiders, scrapers, and automated data collection workflows.
• Work with websites having different structures, page types, and technical behaviors.
• Extract useful information from web pages and convert it into structured data.
• Work with HTTP requests, HTML, JSON, APIs, and web technologies.
• Handle crawling challenges such as redirects, errors, retries, pagination, dynamic content, and changing page structures.
• Troubleshoot and improve crawler and extraction performance.
• Write clean, maintainable, and testable Python code.
• Work with databases or structured storage for collected data.
• Monitor and improve the reliability and efficiency of automation processes.
• Collaborate with backend and other technical team members as the system develops.

Requirements

• Strong Python programming skills.
• Understanding of web technologies and how websites work.
• Experience with or strong understanding of web scraping, crawling, or web automation.
• Familiarity with HTTP requests, HTML, JSON, and APIs.
• Experience with tools or frameworks such as Scrapy, BeautifulSoup, Requests, HTTPX, Selenium, or Playwright.
• Ability to troubleshoot technical problems independently.
• Understanding of structured data and databases.
• Familiarity with Git and basic software development practices.

Skills

• Python
• Scrapy
• Selenium
• BeautifulSoup
• Playwright

Nice to Have

• Experience building crawlers or automation systems at scale.
• Experience handling JavaScript-heavy or dynamically generated websites.
• Experience with browser automation.
• Experience with concurrency, retries, rate limiting, proxies, or similar crawling techniques.
• Experience with PostgreSQL, SQLite, or similar databases.
• Experience deploying Python applications or automation systems.
• Understanding of asynchronous programming in Python.