Role Overview
Tenstorrent is leading in cutting-edge AI technology and building a high-performance RISC-V CPU. This team makes it run on Tenstorrent hardware for real models and scale. The AI Software Intern will help build infrastructure that keeps engineering moving fast.
Responsibilities
- Develop high-performance kernels on Tenstorrent hardware.
- Optimize ML models, including LLMs and vision models, for hardware.
- Develop and serve-side optimize the inference server.
- Build software to manage memory, task scheduling, and code execution.
- Handle communication and coordination between devices in distributed AI systems.
- Create tools to optimize AI models into high-performance programs.
Requirements
- Currently pursuing a BS, MS, or PhD in Computer Science, Computer Engineering, Physics, Math, or related field.
- Coursework or projects in parallel processing, machine learning, or distributed systems.
- High comfort level as an end user of AI and agentic flows.
- Experience with model quantization, kernel fusion, or other optimization techniques; or low-level high-performance programming.
- Hands-on experience with PyTorch, experimenting with and deploying models for inference or training.
- Experience with C/C++ or kernel development in languages like CUDA, or Python and at least one ML framework.
- Knowledge of RTL, HDL is nice to have on certain teams.