Role Overview
Engramme is a Frontier AI lab spun out of Harvard focusing on AI x Human Memory, seeking to build models of human memory and endow humans with perfect and infinite memory. This is a 6-month, in-person opportunity in San Francisco.
Responsibilities
- Build automated eval pipelines for memory retrieval, compression, and reconstruction.
- Design benchmarks for context retention, long-term consistency, and memory safety.
- Analyze model behavior, surface failure modes, and define quality metrics.
- Run large-scale experiments and maintain continuous evaluation systems.
- Develop internal tools, dashboards, and workflows for fast debugging.
- Integrate evals directly into production with backend + research teams.
Requirements
- Strong Python + ML framework experience.
- Background in eval pipelines, model testing, or benchmarking.
- Understanding of LLMs, embeddings, or retrieval systems.
- Ability to analyze failures, define metrics, and reason from first principles.
- Comfortable moving fast and owning core architecture.
Nice to Have
- Experience with vector DBs, similarity search, or interpretability.
- Distributed systems or high-throughput pipeline experience.
- Startup experience or ML tooling/open-source contributions.
- Familiarity with monitoring/experiment-tracking tools.