Data Engineer

Role Overview

At SOTI, we are committed to delivering best in class mobile and IoT device management solutions. We are looking for out of the box thinkers that appreciate the art of creating great software. We seek a professional to design, build, and maintain efficient ETL/ELT pipelines and implement Medallion architecture to drive business insights through scalable data solutions.

Responsibilities

• Design, build, and maintain efficient ETL/ELT pipelines to support data ingestion and transformation.
• Implement Medallion architecture (Bronze, Silver, Gold layers) to ensure modularity and scalability.
• Collaborate with Data Architecture and BI Engineers to align with enterprise data models.
• Maintain and support hybrid data environments including SQL Server, Azure Synapse Analytics, and Microsoft Fabric.
• Implement monitoring, logging, and alerts to ensure pipeline performance.
• Maintain data reconciliation, unit testing, CI/CD, and version control.
• Support data governance, metadata management, and data lineage practices.
• Document technical designs and processes to support maintainability.

Requirements

• 3–5 years of experience in data engineering or a similar technical role.
• Strong proficiency in SQL for complex querying and performance tuning.
• Hands-on experience with ETL/ELT development and building scalable data pipelines.
• Advanced skills in Python and PySpark for data processing.
• Experience with C# for integration and automation.
• Practical expertise with Microsoft Fabric (Lakehouse, Warehouse, Pipelines, Notebooks).
• Strong experience with Azure data services including ADF, ADLS, Synapse, Databricks, and Azure SQL.
• Familiarity with CI/CD and DevOps practices.

Skills

• SQL
• Python
• PySpark
• Microsoft Fabric
• Azure