AI Data Engineer

Role Overview

We are looking for an AI Data Engineer to build and manage data platforms that power Generative AI, RAG, and intelligent automation solutions. The ideal candidate should have strong experience in Azure data services, Python, data pipelines, and search technologies, with exposure to AI-driven applications.

Responsibilities

• Design and develop scalable data ingestion pipelines using Azure services.
• Integrate enterprise data sources such as SharePoint, Azure DevOps, databases, and document repositories.
• Build document processing and data transformation workflows for AI applications.
• Build and maintain Retrieval Augmented Generation (RAG) solutions.
• Manage vector databases and Azure AI Search indexes.
• Optimize document chunking, embeddings, and search relevance.
• Support AI-powered applications using Azure OpenAI and related services.
• Contribute to Agentic AI and workflow orchestration initiatives using tools such as LangGraph or LangFlow.
• Implement RBAC, Row-Level Security, and data governance controls.
• Monitor data pipelines and AI services using Azure Monitor and Log Analytics.

Requirements

• Strong Python and SQL programming skills.
• Experience with Azure Data Services (Databricks, Synapse, Data Factory, Functions).
• Experience building data pipelines and ETL/ELT solutions.
• Hands-on experience with Azure AI Search or similar search platforms.
• Understanding of RAG, embeddings, and vector search concepts.
• Experience with REST APIs and data integration.
• Bachelor's or Master's degree in Computer Science, Data Engineering, IT, or related field.

Skills

• Python
• Azure
• SQL
• Azure AI Search
• Databricks

Nice to Have

• Azure OpenAI Service
• LangChain
• LangFlow
• Agentic AI or Multi-Agent Systems
• Dagster or workflow orchestration frameworks