Role Overview
NVIDIA seeks a Software Engineering Intern to build infrastructure and agentic AI services for internal teams. You will design and ship production backend services and APIs at massive scale, build AI agents connecting LLMs to tools, and help make them reliable and safe. Work alongside senior engineers on real products used across NVIDIA.
Responsibilities
- Design, build, and improve backend services and APIs for automated workflows at massive scale
- Build AI agents and agentic workflows connecting LLMs to tools and internal services
- Ensure agent reliability and safety via access control, guardrails, and quality evaluation
- Assist with data pipelines and GPU job orchestration for synthetic data and model evaluation
- Implement observability (tracing, metrics, logging) for distributed services and agents
- Participate in code reviews, testing, debugging, and apply software engineering best practices
Requirements
- Currently pursuing a Bachelor's or Master's degree in Computer Science, Engineering, or related field
- Strong programming fundamentals in at least one of: Go, Python, or C#
- Solid understanding of data structures, algorithms, software design patterns, and API design concepts
- Hands-on experience building with LLMs via project, prototype, or coursework using LLM APIs
- Familiarity with version control systems (Git)
- Understanding of database concepts and SQL
- Strong problem-solving skills and excellent communication and teamwork abilities
Nice to Have
- Experience building AI agents or LLM-powered applications (tool calling, MCP, RAG, LangGraph, NeMo Agent Toolkit)
- Cloud platforms (AWS, GCP, Azure), GPU workloads, and infrastructure automation
- CI/CD, DevOps, observability (OpenTelemetry, Prometheus, Grafana), and orchestration (Kubernetes)