Sr. AI Engineer (Applied AI & ML Systems)

Jobgether · US

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Sr. AI Engineer (Applied AI & ML Systems) based in the United States.

This role focuses on designing and deploying advanced AI systems that combine machine learning, large language models, and agentic workflows to solve complex, real-world business problems.
You will be responsible for building production-grade AI solutions that balance accuracy, scalability, latency, cost, and reliability across enterprise environments.
The position emphasizes an evaluation-first engineering approach, ensuring that every AI system is designed with clear success metrics, monitoring, and continuous improvement strategies.
You will collaborate closely with product, engineering, and business stakeholders to identify opportunities and translate them into scalable AI-driven solutions.
The environment is highly technical, fast-evolving, and innovation-driven, with a strong focus on experimentation and responsible AI deployment.
This is a high-impact role where your work directly shapes how intelligent systems are built, measured, and operated at scale.

Accountabilities:

  • Design, build, and deploy AI systems using machine learning, LLMs, retrieval-augmented generation (RAG), and agentic workflows to address business needs.
  • Define evaluation frameworks and success metrics upfront, including offline/online testing, monitoring strategies, and error analysis.
  • Develop and optimize LLM-powered applications using prompt engineering, context engineering, and multi-step reasoning pipelines.
  • Build and maintain production-grade AI systems, including data pipelines, model serving infrastructure, and observability tools.
  • Collaborate with cross-functional teams to prioritize AI use cases and align on performance, delivery, and business impact goals.
  • Monitor and improve deployed AI systems by balancing quality, latency, cost, reliability, and maintainability.
  • Implement experimentation frameworks, versioning strategies, and continuous improvement cycles for deployed models.
  • Design agentic AI systems with planning, tool orchestration, memory, and human-in-the-loop workflows.
  • Support deployment of scalable AI solutions using cloud-native and distributed system architectures.
  • Requirements:

    • Bachelor’s degree in Computer Science or related field with 6+ years of relevant technical experience.
    • 4+ years of experience in Machine Learning, Data Engineering, or Software Engineering for data-intensive systems.
    • 2+ years of experience building LLM-based applications, including at least 1 year working with agentic AI systems.
    • Strong hands-on experience with RAG systems, prompt engineering, context engineering, and LLM optimization techniques.
    • Experience building and operating production-grade data pipelines or large-scale AI/ML systems.
    • Advanced Python skills with experience taking AI systems from prototype to production.
    • Strong understanding of AI system evaluation, monitoring, observability, and performance tuning.
    • Experience balancing system trade-offs including cost, latency, reliability, and scalability.
    • Strong collaboration and communication skills across technical and non-technical stakeholders.
    • Ability to work effectively in ambiguous environments with a strong ownership and problem-solving mindset.
    • Benefits:

      • Competitive salary range ($160,000 – $205,000 depending on experience and location)
      • Annual performance bonus (up to 10%)
      • Comprehensive healthcare coverage (medical, dental, vision, and international options where applicable)
      • Retirement and pension plan contributions plus equity participation opportunities
      • Paid time off including vacation, holidays, and volunteer days
      • Remote-first flexibility with home office setup allowance
      • Learning and development support including tuition reimbursement and training programs
      • Career growth opportunities in advanced AI and machine learning systems
      • Wellness, life, and disability insurance coverage
      • Additional optional benefits including legal assistance, identity protection, and pet insurance

AI Engineering pay context

Based on 584 disclosed AI Engineering salaries on RoleSuite, the role pays a median of $199K/year, with most offers between $162K and $237K (10th–90th percentile: $129K–$274K).

This posting lists $160K–$205K, in line with the $199K market median.

See the full AI Engineering salary breakdown →
Apply →