Softchoice logo for Software Engineer, AI job on DevsUnite

Software Engineer, AI

Softchoice

Actively HiringFull-time
Apply
Location

Toronto, Ontario, Canada

Experience

4-6 years

Role

Software Engineer, AI

Salary

Competitive

Share this job

Know someone who'd be a great fit?

Job Description

Role Overview

Softchoice, a World Wide Technology company, seeks a Software Engineer, AI to design and deliver production-grade AI solutions. You will independently build complex components—from LLMs and RAG pipelines to secure backend services and cloud-native APIs—turning AI proofs of concept into scalable, responsible applications for enterprise clients across the U.S. and Canada.

Responsibilities

  • Design, build, test, deploy, and support AI applications using LLMs, RAG, semantic search, and agentic workflows.
  • Develop secure backend services, APIs, and cloud-native integrations connecting AI with enterprise data.
  • Optimize ingestion, chunking, embeddings, retrieval, prompting, grounding, tool use, and workflow orchestration.
  • Evaluate models and platforms for quality, latency, cost, scalability, security, and responsible AI.
  • Productionize solutions via automated testing, observability, MLOps/LLMOps, CI/CD, and infrastructure-as-code.
  • Participate in architecture/design/code reviews; create reusable components, documentation, and runbooks.
  • Collaborate with customers, architects, data teams, and stakeholders through discovery, design, demos, and knowledge transfer.

Requirements

  • 4–6 years software engineering experience, including 2+ years delivering production-grade AI/ML/generative AI solutions.
  • Strong Python skills plus at least one additional language (TypeScript/JavaScript, Java, C#, or Go).
  • Experience building backend services, APIs, databases, auth, and event-driven applications.
  • Hands-on with Azure, AWS, or Google Cloud and modern AI platforms (Azure AI Foundry, Amazon Bedrock, Vertex AI, OpenAI, Anthropic, open-source models).
  • Practical experience with LLM apps, RAG, embeddings, vector search, prompt engineering, AI agents, evaluation, and data pipelines.
  • Experience developing modern web applications with React or Next.js.
  • Solid understanding of software architecture, secure development, responsible AI, and component-level design.
  • Proficiency with AI-assisted engineering tools (GitHub Copilot, Cursor, Claude Code).
  • Strong communication, estimation, Agile delivery, and customer-facing collaboration.

Required Skills

PythonReact.jsAWSLLMsMLOps

Ready to apply for Software Engineer, AI?

See how you stack up at Softchoice before you apply, or go straight to the application.

Apply Anyway