Download App
Data Engineer - Chennai / Bengaluru
Photon
Actively HiringFull-time
Location
TN, IN
Experience
Not disclosed
Role
Data Engineer - Chennai / Bengaluru
Salary
Competitive
Your Application Toolkit
Stand out. Get hired.
80% of applicants fail the initial ATS screen. Check your compatibility before you apply and stand out from the crowd.
Share this job
Know someone who'd be a great fit?
Job Description
Role Overview
We are looking for a Data Engineer to develop and maintain robust data pipelines, ELT processes, and workflow orchestration to ensure efficient and reliable data delivery.
Responsibilities
- Develop and maintain data pipelines, ELT processes, and workflow orchestration using Apache Airflow, Python, PySpark, Hive(Trino) and Snowflake.
- Design and implement custom connectors to facilitate the ingestion of diverse data sources, including structured and unstructured data.
- Collaborate with cross-functional teams to translate data needs into technical solutions.
- Design and implement data CI/CD pipelines for automated integration and deployment.
- Monitor and troubleshoot pipelines to resolve ingestion, transformation, and loading issues.
- Conduct data validation and testing to ensure accuracy, consistency, and compliance.
- Document data workflows and technical specifications for data governance.
Requirements
- Proven experience in designing and implementing scalable data architectures.
- Strong understanding of data orchestration and ETL/ELT methodologies.
- Experience with CI/CD processes in a data environment.
Skills
- Apache Airflow
- Python
- PySpark
- Hive(Trino)
- Snowflake
Required Skills
Apache AirflowPythonPySparkHive(Trino)Snowflake
Ready to make your move?
Take the next step in your career. Apply directly on the company's platform.
Apply for this role