Data Engineer / Data Science

Role Overview

We are looking for experienced Data Engineer / Data Science to work on an AI-focused software engineering project involving real-world open-source codebases and LLM evaluation. This role involves hands-on work with production-like datasets, data pipelines, and data science tasks to help evaluate and improve the performance of advanced AI systems.

Responsibilities

• Work with structured and unstructured datasets to support SWE Bench-style evaluation tasks.
• Design, build, and validate data pipelines used in benchmarking and evaluation workflows.
• Perform data processing, analysis, feature preparation, and validation for data science use cases.
• Write, run, and modify Python code to process data and support experiments locally.
• Evaluate data quality, transformations, and outputs for correctness and reproducibility.
• Create clean, well-documented, and reusable data workflows suitable for benchmarking.
• Participate in code reviews to ensure high standards of code quality and maintainability.
• Collaborate with researchers and engineers to design challenging, real-world data engineering and data science tasks for AI systems.

Requirements

• Minimum 3+ years of overall experience as a Data Engineer, Data Scientist, or Software Engineer (data-focused).
• Strong proficiency in Python for data engineering and data science workflows.
• Demonstrable experience with data processing, analysis, and model-related workflows.
• Solid understanding of machine learning and data science fundamentals.
• Experience working with structured and unstructured data.
• Ability to understand, navigate, and modify complex, real-world codebases.
• Experience writing readable, reusable, maintainable, and well-documented code.
• Strong problem-solving skills, including experience with algorithmic or data-intensive problems.
• Excellent spoken and written English communication skills.

Skills

• Python
• Machine Learning
• Data Engineering
• Data Science
• LLM Evaluation

Work Requirements

• Minimum 8 hours per day / 40 hours per week.
• Must be available for at least 4 hours of overlap with PST.
• Fully remote opportunity.
• 3-month contractor assignment.