Engineer, Machine Learning Tools

Role Overview

Join the exciting Generative AI team at Qualcomm focused on integrating cutting edge GenAI models on Qualcomm chipsets. As an Engineer, Machine Learning Tools, you will spearhead the development and commercialization of the Qualcomm AI Runtime (QAIRT) SDK on Qualcomm SoCs, pushing the limits of performance for large models using heterogeneous computing capabilities to allow inference of GenAI models on-device.

Responsibilities

• Spearhead the development and commercialization of the Qualcomm AI Runtime (QAIRT) SDK on Qualcomm SoCs.
• Deploy large C/C++ software stacks using best practices.
• Stay on the cutting edge of GenAI advancements, including LLMs and Transformers.
• Optimize edge-based GenAI deployment for performance and power efficiency.

Requirements

• Master’s/Bachelor’s degree in computer science or equivalent.
• 6+ years of relevant work experience in software development.
• Strong understanding of Generative AI models (LLM, LVM, LMMs) and building blocks like self-attention and kv caching.
• Knowledge of Floating-point, Fixed-point representations, and Quantization concepts.
• Experience optimizing algorithms for AI hardware accelerators (CPU/GPU/NPU).
• Strong proficiency in C/C++ programming, Design Patterns, and OS concepts.
• Good scripting skills in Python.

Skills

• C/C++
• Python
• Generative AI
• PyTorch
• Quantization

Nice to Have

• Strong understanding of SIMD processor architecture and system design.
• Familiarity with Linux and Windows environments.
• Experience with frameworks like llama.cpp, MLX, and MLC.
• Knowledge of PyTorch, TFLite, and ONNX Runtime.
• Experience with parallel computing languages like OpenCL and CUDA.