Role Overview
NVIDIA seeks a Software Engineering Intern to build infrastructure and agentic AI services that remove bottlenecks for internal teams. You'll work alongside senior engineers to design, build, and ship production systems — from backend services running automated workflows at massive scale to AI agents that automate routine engineering tasks. This role offers hands-on experience with agentic AI and modern infrastructure while contributing to real products used across NVIDIA.
Responsibilities
- Design, build, and improve backend services and APIs for internal platforms running automated workflows at massive scale
- Build AI agents and agentic workflows connecting LLMs to tools and internal services, integrating them into production systems
- Ensure agent reliability and safety in production — access control, guardrails, and quality evaluation
- Build data pipelines and GPU job orchestration for synthetic data generation and model evaluation at scale
- Implement observability (tracing, metrics, logging) for distributed services and agents
- Participate in code reviews, testing, debugging, and apply software engineering best practices
- Work product-minded: engage internal users, prototype quickly, collect feedback, and iterate
Requirements
- Pursuing Bachelor's or Master's in Computer Science, Engineering, or related field
- Strong programming fundamentals in Go (preferred), Python, or C#
- Solid understanding of data structures and algorithms
- Basic knowledge of software design patterns and API design concepts
- Hands-on experience building with LLMs (project, prototype, or coursework using LLM APIs)
- Familiarity with Git version control
- Understanding of database concepts and SQL
- Strong problem-solving skills and eagerness to learn new technologies
- Excellent communication and teamwork abilities
Nice to Have
- Experience building AI agents or LLM-powered applications: tool/function calling, MCP, RAG, or agent frameworks (e.g., LangGraph, NVIDIA NeMo Agent Toolkit)
- Distributed systems concepts (REST APIs, microservices) and containerization (Docker)
- Cloud platforms (AWS, GCP, Azure), GPU workloads, infrastructure automation
- CI/CD pipelines, DevOps practices, observability tools (OpenTelemetry, Prometheus, Grafana), orchestration (Kubernetes)
- Database technologies (MySQL, MongoDB, Redis, Elasticsearch)