Role Overview
We are seeking a Data Engineer specializing in AI, API Integration, and Application Monitoring. You will design and maintain scalable data pipelines for property tax filing applications, ensuring seamless data exchange through REST APIs and supporting AI/ML initiatives through robust data preparation and validation.
Responsibilities
- Design, develop, and maintain scalable data pipelines supporting property tax filing and tax-related applications.
- Build and integrate REST APIs to exchange data between internal applications, third-party tax systems, and government databases.
- Develop data ingestion and transformation workflows using Python, SQL, and PySpark.
- Work with AI/ML teams to prepare, process, and validate data for automation and prediction use cases.
- Implement application logging, monitoring, and error tracking across APIs and data pipelines.
- Analyze application logs to identify failures, performance issues, and data-quality problems.
- Build dashboards and alerts using tools such as Splunk, ELK, Grafana, Azure Monitor, or CloudWatch.
- Ensure data accuracy, security, reliability, and auditability for property tax filing workflows.
- Collaborate with software engineers, AI/ML engineers, DevOps, and business teams to troubleshoot production issues.
- Optimize API performance, data processing jobs, and database queries.
Requirements
- Proven experience in building and maintaining scalable data pipelines.
- Strong proficiency in Python and SQL.
- Experience with ETL/ELT processes and REST APIs.
- Familiarity with cloud environments such as Azure or AWS.
- Experience with application monitoring and logging tools.
Skills
- Python
- PySpark
- SQL
- REST APIs
- Azure