Download App
Big Data Engineer
WebSenor InfoTech
Actively HiringFull-time
Location
UP, IN
Experience
Not disclosed
Role
Big Data Engineer
Salary
Competitive
Your Application Toolkit
Stand out. Get hired.
80% of applicants fail the initial ATS screen. Check your compatibility before you apply and stand out from the crowd.
Job Description
Job Title: Big Data Engineer (EL3)
Experience: 4+ Years
Location: Onsite
Employment Type: Full-Time
Job Summary
We are seeking an experienced Big Data Engineer to design, develop, and optimize scalable big data solutions. The ideal candidate should have strong expertise in Scala, PySpark, AWS Glue, and data validation frameworks, along with experience in building high-performance data pipelines and working with large-scale datasets.
Key Responsibilities
- Design, develop, and optimize scalable, rule-based data validation engines capable of validating data across multiple data pipelines.
- Build and maintain high-performance big data pipelines using Scala, PySpark, and AWS Glue.
- Write clean, efficient, and well-tested code while utilizing optimized file formats such as Parquet for efficient data storage and retrieval.
- Perform data validation, profiling, and quality checks to ensure data consistency and accuracy across various data systems.
- Leverage enterprise-approved AI coding tools (e.g., GitHub Copilot, Codex) to improve software development productivity and automate routine tasks.
- Collaborate with cross-functional teams to translate business requirements into scalable technical solutions.
- Research and evaluate emerging AI technologies and big data trends to improve solution architecture and innovation.
- Participate in code reviews, testing, debugging, and performance optimization to ensure high-quality software delivery.
Required Skills &…
Skills
- AWS
- Scala
Required Skills
AWSScala
Ready to make your move?
Take the next step in your career. Apply directly on the company's platform.
Apply for this role