DevJobs
RoleSuite
CompaniesRemoteAboutMethodologyContactPrivacy
Updated 2026-06-16 02:00 UTC·© 2025–2026 RoleSuite
← Back to listings

AI Computing Development Engineer, TensorRT and TensorRT-LLM AIGV

NVIDIA · China, Shanghai

NVIDIA is hiring software engineers for its AI Computing team. Academic and commercial groups around the world are using GPUs to power a revolution in deep learning-powered AI, enabling breakthroughs in areas like generative AI, computer vision, speech recognition, recommender systems, and large-scale language and multimodal models. Join the team building the inferencing software (TensorRT/TensorRT-LLM) that will be used across our product lines. The ability to work in a fast-paced, delivery-focused environment is required, and excellent interpersonal skills are a must.

What you'll be doing:

  • Design and develop robust inferencing software (TensorRT/TensorRT-LLM) optimized for functionality and performance across platforms

  • Perform performance analysis, optimization, and tuning of deep learning inference workloads

  • Track and integrate academic and industry advancements in AI and feature-update TensorRT/TensorRT-LLM accordingly

  • Provide feedback into architecture and hardware design and development

  • Collaborate across hardware, software, and research teams to shape the direction of machine learning inferencing across NVIDIA platforms

  • Own and deliver technical work with scope based on experience, ranging from complex features to substantial parts of larger projects, with increasing independence and technical leadership over time

  • Publish key technical results at leading scientific and engineering conferences

What we need to see:

  • Masters or higher degree in Computer Engineering, Computer Science, Applied Mathematics, or related computing-focused field (or equivalent experience)

  • Strong Python or C/C++ programming and software design experience, including debugging, performance profiling, and test design

  • 2+ years working experience

  • Strong curiosity about artificial intelligence and familiarity with the latest developments in deep learning — including generative models, multimodal systems, and large neural networks

  • Experience working with deep learning frameworks such as PyTorch, TensorRT/TensorRT-LLM, SGLang or vLLM

  • Proactive, self-driven, and able to work independently

  • Excellent written and verbal communication skills in English

  • Demonstrated ability, commensurate with experience, to take technical ownership, solve complex problems, and contribute effectively in cross-functional environments

NVIDIA is widely considered to be one of technology’s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working for us. Does the idea of contributing to and pushing the boundaries of state-of-the-art AI and compute systems excite you? Interested in getting exposure to the entire deep learning software stack? Come join us and help build the GPU-accelerated AI platform used worldwide.

Software pay context

Based on 7,311 disclosed Software salaries on RoleSuite, the role pays a median of $158K/year, with most offers between $123K and $199K (10th–90th percentile: $101K–$236K).

See the full Software salary breakdown →
Apply →

Other roles at NVIDIA

  • Software Quality Assurance Engineer - 2026 New College GradUS, CA, Santa Clara
  • Solution Architecture Intern, AI Infra - 2026China, Beijing
  • Senior Applied AI EngineerIsrael, Yokneam
  • Senior Product Manager – Host Networking PlatformsIsrael, Yokneam
  • AI Compute Engineer - NVISUS, CA, Santa Clara
  • Senior Technical Program Manager, AI SoftwareUS, MA, Remote
  • Senior Technical Program Manager, Deep Learning SoftwareUS, CA, Santa Clara
  • Senior Software Engineer, AIOpsIsrael, Raanana
  • Senior System Software EngineerIndia, Bengaluru
  • Senior Solutions Architect, Infiniband and Networking Ethernet - NVISTaiwan, Hsinchu

More Software roles

  • Engineer II - Quality & Testing ( Manual /Functional) (IN)Value Apothecaries · Pune, India
  • Engineer I - Quality & Testing (Manual/Functional) (IN)Value Apothecaries · Pune, India
  • Engineer I - Quality & Testing (Manual/Functional) (IN)Value Apothecaries · Pune, India
  • Customer Transformation - Associate Director - Technical ArchitectPwC · Auckland - NZL
  • Customer Transformation - Associate Director - Technical ArchitectPwC · Auckland - NZL
  • Module EngineerIntel · Malaysia, Penang
  • 28卒対象 CXサマーインターンシップ - コンサルティングエンジニア職 (Consulting Engineer)Cisco · Minato, Japan
  • Lead Software EngineerJPMorgan Chase · Jersey City, NJ, United States
  • Software Development Engineer, S3 Object APIAmazon · Seattle, Washington, USA
  • Software Dev manager, DC Edge Fabric EngineeringAmazon · Melbourne, Victoria, AUS