AIEngJobs
RoleSuite
CompaniesRemoteAboutMethodologyContactPrivacy
Updated 2026-06-10 01:00 UTC·© 2025–2026 RoleSuite
← Back to listings

Deep Learning Performance Architect

NVIDIA · China, Shanghai

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.

NVIDIA is developing processor and system architectures that accelerate AI workloads based on neural networks. We are looking for an experienced deep learning performance architect to join our inference architecture team. In this position, you will have a chance to work on DL performance modelling, analysis, and optimization on brand-new hardware architectures for various DL workloads. You will make your contributions to our dynamic technology-focused company.

What you will be doing:

  • Analyze brand-new DL networks (LLM etc.), identify and prototype performance opportunities to influence SW and Architecture team for NVIDIA's current and next-gen inference products.

  • Develop prototypes of the fastest kernels on present and future NVIDIA GPUs.

  • Define hardware and software setups along with measurements to evaluate performance, power consumption, and accuracy in current and upcoming chips.

  • Collaborate across the company to guide the direction of next-gen deep learning HW/SW by working with architecture, software, and product teams.

What we need to see:

  • BS, MS, or PhD in a relevant field (CS, EE, Math, etc.) or equivalent experience.

  • 5+ years’ work experience.

  • Excellent C/C++ programming and software build skills.

  • Experience in kernel development and performance tuning on GPUs (or other accelerators).

  • Familiarity with typical deep learning SW frameworks (e.g., Torch/JAX/TensorFlow/TensorRT) and popular AI models (e.g., LLM and AIGC models).

  • Familiarity and background with hardware frameworks for deep learning applications.

Ways to stand out from the crowd:

  • Experience in the performance optimization of DL workloads.

  • Experience with MLIR and AI compiler development.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

Apply →

Other roles at NVIDIA

  • Senior Program Manager, Architecture Review BoardSingapore, Singapore-Suntec Tower
  • Senior Compiler Optimization Engineer – LLVMIndia, Bengaluru
  • Cloud Distributed Systems Backend Intern, GeForce NOW - Fall 2026US, CA, Santa Clara
  • Senior Firmware Application Engineer - System SoftwareTaiwan, Taipei
  • Senior Research Scientist, RenderingUS, WA, Redmond
  • DL System Software Engineer - AI PlatformCanada, Toronto
  • Senior Software Engineer - Infrastructure and ToolsUS, MA, Westford
  • Senior Site Reliability EngineerUS, CA, Santa Clara
  • ASIC Design EngineerUS, CA, Santa Clara
  • GPU Architect - New College Grad 2026US, CA, Santa Clara

More AI Engineering roles

  • AI Engineer, Sensing & ConnectivityApple · Cupertino
  • Lead AI Engineer, Finance Digital TransformationApple · Cork
  • Machine Learning Engineer, Proactive — Large Language Models, Generative AI & Agentic Systems Apple · Cupertino
  • Subject Matter Expert - Automation & AI/MLApple · Shenzhen
  • Senior Machine Learning Engineer, AI PlatformMozilla · Remote Canada
  • Senior Machine Learning Engineer, AI PlatformMozilla · Remote US
  • Forward Deployed Engineer, Lead - AI EngineerReflectionai · Seoul
  • Forward Deployed Engineer - AI EngineerReflectionai · Seoul
  • Lead Aiml EngineerWeekdayworks · Bengaluru
  • Senior Machine Learning Engineer - Music Recommendation EngineApple · London