Role Overview
We are seeking an AI Engineer, Agent/Platform Tracks to join our team. As an AI Engineer focused on agent development, you will drive the design and implementation of specialized pharmacovigilance agents that transform how adverse event data is processed and analyzed. This position plays a critical role in building intelligent systems that advance clinical research safety and efficiency, working alongside domain experts to create cutting-edge AI solutions that set new standards in the industry.
Responsibilities
- Implement specialized pharmacovigilance agents by writing system prompts, configuring model parameters, and building tool-use definitions.
- Build and iterate prompt chains for source document parsing, field extraction, MedDRA coding, and narrative drafting.
- Develop deterministic rule engine layers for field validation and regulatory logic constraints.
- Create and maintain evaluation datasets, including annotated ground-truth cases and regression test suites.
- Develop and maintain Model Context Protocol (MCP) servers to expose enterprise applications and APIs as tools for AI agents.
- Run accuracy benchmarks and analyze failure modes to improve agent performance.
- Implement quality control cross-verification logic and human-in-the-loop feedback mechanisms.
Requirements
- 3+ years of software engineering experience, with at least 1 year building applications using LLM APIs (Anthropic, OpenAI, or equivalent).
- Proficiency in Python in production environments.
- Experience building and evaluating NLP or LLM-based systems with measurable quality metrics.
- Strong prompt engineering skills (few-shot, chain-of-thought, structured outputs).
- Experience with LLM orchestration frameworks such as LangChain or LangGraph.
- Comfort with AWS services including S3, Lambda, and IAM.
- Bachelor's degree in Computer Science or a related field.
Nice to Have
- Experience with AWS Bedrock.
- Experience with medical or clinical NLP, including named entity recognition or medical coding.
- Familiarity with MedDRA or ICD-10.
- Exposure to document processing, OCR pipelines, or PDF parsing.
- Experience in pharma, biotech, or healthcare IT environments.
Skills
- Python
- LangChain
- LLM APIs
- AWS
- NLP