Role Overview
As a Custom Software Engineer, your day involves creating tailored software solutions by designing, coding, and improving various components within systems or applications. You engage in collaborative environments that emphasize agile methodologies and modern frameworks to ensure the delivery of scalable and efficient software. Your work focuses on addressing unique business requirements through innovative and high-quality software development, contributing to the overall success of projects and organizational goals.
Responsibilities
- Expected to perform independently and become an SME.
- Required active participation/contribution in team discussions.
- Contribute in providing solutions to work related problems.
- Collaborate with cross-functional teams to understand project requirements and deliver effective software solutions.
- Maintain and enhance existing software components to improve performance and reliability.
- Document development processes and solutions to support knowledge sharing within the team.
- Assist junior team members by providing guidance and support to foster their professional growth.
Requirements
- Minimum 3 years of experience in PySpark.
- Strong knowledge of distributed computing concepts and big data processing frameworks.
- Experience in writing efficient, maintainable, and scalable code for data processing pipelines.
- Familiarity with debugging, testing, and optimizing PySpark applications for performance.
- Understanding of data integration techniques and working with various data sources.
- Ability to work with version control systems and collaborate in agile development environments.
- 15 years full time education is required.
Skills
- PySpark
- Distributed Computing
- Big Data
- Agile
- Data Pipelines