Download App
Cloud Platform Engineer
WebSenor InfoTech
Actively HiringFull-time
Location
Remote, IN
Experience
2-4 years
Role
Cloud Platform Engineer
Salary
Competitive
Your Application Toolkit
Stand out. Get hired.
80% of applicants fail the initial ATS screen. Check your compatibility before you apply and stand out from the crowd.
Share this job
Know someone who'd be a great fit?
Job Description
Role Overview
We are seeking a skilled Cloud Platform Engineer (EL2) to join our team for a Cloud Data Modernization initiative. The ideal candidate will have strong hands-on experience with Databricks as the primary data platform, supported by Snowflake and Azure/AWS cloud infrastructure. The role involves modernizing and migrating on-premises ETL workloads to cloud-based data platforms, developing scalable data pipelines, implementing CI/CD practices, and ensuring strong data quality, observability, security, and performance.
Responsibilities
- Contribute to the migration and modernization of on-premises ETL workloads to cloud platforms.
- Develop and maintain scalable data engineering solutions using Databricks as the primary platform.
- Build data pipelines using Databricks, Apache Spark, PySpark, and Azure Data Factory (ADF).
- Work with Snowflake as a secondary data platform for data engineering and analytics workloads.
- Develop and support integrations using ADF, Self-hosted Integration Runtime (SHIR), Logic Apps, ADLS Gen2, and Blob Storage.
- Implement Bronze/Silver/Gold (Medallion) architecture and Lakehouse patterns using Delta Lake.
- Develop data transformations and ETL/ELT processes using Python, PySpark, and SQL.
- Implement automated data validation, reconciliation, data quality, monitoring, and observability processes.
- Implement and maintain CI/CD pipelines using GitHub Actions.
- Collaborate with cross-functional teams including architects, QA, and business analysts.
Requirements
- Strong hands-on experience with Databricks and PySpark.
- Deep understanding of Delta Lake and Lakehouse architecture.
- Hands-on experience with Azure data services: Azure Data Factory, ADLS Gen2, Azure Blob Storage, and Azure Logic Apps.
- Hands-on experience with Snowflake for data engineering and analytics.
- Strong proficiency in Python and SQL development.
- Experience with Git, GitHub, and GitHub Actions for CI/CD.
- Experience implementing data validation and reconciliation frameworks.
Skills
- Databricks
- PySpark
- Azure
- Snowflake
- Python
Required Skills
DatabricksPySparkAzureSnowflakePython
Ready to make your move?
Take the next step in your career. Apply directly on the company's platform.
Apply for this role