Associate – Python & Data Engineering

Role Overview

Dot & is looking for an Associate – Python & Data Engineering to own the building of a data collection and storage infrastructure from scratch. You will integrate with third-party data APIs, build custom web crawlers, design database structures, and normalize data from multiple sources into a clean, consistent store ready for analysis. This is a long-term role with growing ownership and the opportunity to build internal tooling as the platform matures.

Responsibilities

• Integrate with multiple third-party data APIs, handling authentication, rate limiting, pagination, retries, and inconsistent response schemas
• Build custom web crawlers where public data sources do not offer an API
• Design and manage a relational database to store, organise, and retrieve collected data reliably
• Build standardisation and normalisation logic to transform raw data into a clean, consistent internal structure
• Handle deduplication and data quality management across all sources
• Build scheduled and on-demand data collection pipelines
• Write clean, well-documented code and maintain the data infrastructure

Requirements

• Strong proficiency in Python as a primary language
• Real experience consuming multiple third-party REST APIs
• Proven experience in web crawling/scraping using tools like Scrapy, BeautifulSoup, or Playwright
• Experience in relational database schema design, query writing, and indexing
• Knowledge of data normalisation and deduplication
• Experience with scheduling and automation tools like APScheduler or cron
• Comfortability with cloud basics (AWS, GCP, or Azure)

Skills

• Python
• REST API
• Scrapy
• SQL
• AWS

Benefits

• Health insurance
• Provident Fund