Role Overview
NVIDIA is seeking a Software Engineering Intern to build infrastructure and agentic AI services that power large geo-distributed systems. You will design, build, and ship production backend services and AI agents that automate workflows and reduce bottlenecks for internal teams.
Responsibilities
- Design, build, and improve backend services and APIs for internal platforms running automated workflows at massive scale
- Build AI agents and agentic workflows connecting LLMs to tools and internal services
- Make agents reliable and safe in production with access control, guardrails, and quality evaluation
- Build data pipelines and GPU job orchestration for synthetic data generation and model evaluation
- Implement observability (tracing, metrics, logging) for distributed services and agents
- Participate in code reviews, testing, and debugging with software engineering best practices
- Work product-minded: talk to users, prototype quickly, collect feedback, and iterate
Requirements
- Currently pursuing a Bachelor's or Master's degree in Computer Science, Engineering, or related field
- Strong programming fundamentals in at least one of: Go (preferred), Python, or C#
- Solid understanding of data structures and algorithms
- Basic knowledge of software design patterns and API design concepts
- Hands-on experience building with LLMs (project, prototype, or coursework using LLM APIs)
- Familiarity with version control systems (Git)
- Understanding of database concepts and SQL
- Strong problem-solving skills and eagerness to learn new technologies
- Excellent communication skills and ability to work effectively in a team environment
Nice to Have
- Experience building AI agents or LLM-powered applications: tool/function calling, MCP, RAG, or agent frameworks (e.g., LangGraph, NVIDIA NeMo Agent Toolkit)
- Experience with distributed systems concepts (REST APIs, microservices architecture) and containerization (Docker)
- Knowledge of cloud platforms (AWS, GCP, Azure), GPU workloads, and infrastructure automation
- Familiarity with CI/CD pipelines, DevOps practices, observability tools (OpenTelemetry, Prometheus, Grafana), and orchestration platforms (Kubernetes)
- Experience with database technologies (MySQL, MongoDB, Redis, Elasticsearch)