ForgeApplyTry it free

ForgeApply · Job listing

Senior Development Engineer in Test - AI Tooling & Automation

Salesforce

California - San Francisco, US$149k – $224konsite

See all 151 open roles at Salesforce →

Tailor your resume for this Salesforce job in about a minute.

ForgeApply tailors your resume and cover letter to this exact posting, then hands you a ready-to-submit application for Salesforce's site. Free trial, no card required.

Tailor my resume for this jobView original posting →

About this role

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.

Job Category Software Engineering Job Details

About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn’t a buzzword — it’s a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all.

Ready to level-up your career at the company leading workforce transformation in the agentic era? You’re in the right place! Agentforce is the future of AI, and you are the future of Salesforce.

Software Quality Senior Member of Technical Staff (SMTS)

Job Category: Software Engineering About Salesforce We’re Salesforce, the Customer Company, inspiring the future of business with AI+Data+CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too — driving your performance and career growth, charting new paths, and improving the state of the world. If you believe in business as the greatest platform for change and in companies doing well and doing good – you’ve come to the right place. Job Details

We are infusing AI into every aspect of our software engineering. While AI is accelerating how we build, the depth of intelligence and reliability of our systems is what sets us apart at enterprise scale. We are looking for an enthusiastic Senior Engineer who takes an AI-first approach to help build and evolve our Sales Agent and Forecasting capabilities within the Revenue Action Orchestration (RAO) organization. This individual will work on cutting-edge AI-powered products that tackle one of the most critical problems for enterprise sales teams — accurate revenue forecasting and intelligent sales automation. You will play a key role in designing, implementing, and maintaining robust, scalable systems that bring AI-driven insights directly into the hands of sales teams worldwide. As a member of the RAO team, you will collaborate with cross-functional partners across product development, data science, and AI teams to deliver Salesforce's AI-driven Sales Agent and Forecasting solutions to the highest quality standards for enterprise applications. The ideal candidate has a strong engineering foundation, a passion for AI/ML-powered products, and the drive to be a multiplier — helping the team accelerate velocity and accuracy through modern AI tooling and practices. Prior experience on a Data Science, ML Science, or ML Engineering team is a plus.

Key Responsibilities Drive Innovation & Adoption: Design, build, and maintain scalable, AI-first testing frameworks and automation suites to validate complex RAO workflows and agentic capabilities. Execute Quality Strategies: Translate high-level quality strategies into actionable automation plans, focusing heavily on validating LLM integrations, prompt accuracy, and deterministic system behaviors. Hands-on Code Quality & White-Boxing: Dig deep into the application code to understand system architecture, identify quality gaps, perform white-box testing, and actively contribute to fixing code and test flakiness. Human-in-the-Loop & Model Evaluation: Implement and support evaluation processes for subjective quality dimensions of our AI features, including response relevance, user safety, and contextual accuracy. Cross-Functional Collaboration: Partner closely with developers, product managers, and engineers within the RAO ecosystem to ensure quality is integrated early and continuously throughout the agile delivery lifecycle. Required Skills and Qualifications Strong Java Skills: Strong technical fundamentals of Java, particularly in data structures and algorithms. AI/LLM Validation Mindset: Hands-on experience evaluating Large Language Models (LLMs) for quality response, including familiarity with GPT-like models and AI evaluation frameworks is a big plus. Agile Delivery at Pace: Proven track record of delivering automation solutions in a fast-paced CI/CD environment, supporting rapid deployment schedules without compromising quality. Collaboration & Communication: Excellent communication skills, with the ability to work cross-functionally with product managers, engineers, AI/ML engineers, and data scientists. Problem-Solving & Analytical Skills: Strong analytical and problem-solving abilities with a focus on identifying quality gaps and driving improvement. Preferred Qualifications A software engineer with a strong coding background and understanding of delivering software at pace in Agentic PDLC. Strong experience with white-box testing and fixing code is a huge plus. Experience working with public cloud infrastructure (AWS/Azure/GCP) and/or foundational knowledge of the Salesforce platform (Salesforce Certifications are a plus). Prior experience testing autonomous agents, conversational UIs, or generative AI workflows.

Unleash Your Potential When you join Salesforce, you’ll be limitless in all areas of your life. Our benefits and resources support you to find balance and   be your best , and our AI agents accelerate your impact so you can   do your best . Together, we’ll bring the power of Agentforce to organizations of all sizes and deliver amazing experiences that customers love. Apply today to not only shape the future — but to redefine what’s possible — for yourself, for AI, and the world.

Accommodations If you need a reasonable accommodation during the application or the recruiting process, please submit a request via this Accommodations Request Form .

Please note that Salesforce uses artificial intelligence (AI) tools to help our recruiters assess and evaluate candidates’ resumes and qualifications thr

Salary insight

The midpoint of this range ($186k) is about 7% below the median disclosed salary for San Francisco roles listed on ForgeApply ($200k across 8,351 jobs).

Based on live postings with disclosed pay on ForgeApply; refreshed daily. Not an estimate of this employer's offer.

Tailor your resume for this Salesforce role before you apply.

Tailor my resume for this job

Similar jobs

Free ATS checker · How to Tailor Your Resume to a Job Description (Step by Step)