Senior Computer Scientist

About this role

Senior AI Architect Commerce Factory — Agent Harness & Learning Layer

THE OPPORTUNITY Adobe Unified Platform is building a platform that is transforming how software is developed at Adobe. The platform understands builders’ intent, breaks complex work into manageable steps, accomplishes work through autonomous agents, and learns from each development cycle. Commerce Factory is a core component of this platform. It provides the Agentic Builders Experience that enables agents to understand goals, plan and execute work, use tools, evaluate outcomes, and improve over time. We are looking for a Senior AI Architect to define and lead the architecture for Commerce Factory’s Agent Harness and Learning Layer. This role will build how agents complete tasks, evaluate results, learn from feedback, and improve from one release to the next. You will establish technical direction for learning, feedback, and evaluation across the platform. You will work closely with engineers, architects, product leaders, and platform teams to build scalable systems that support a broad range of agentic use cases across Adobe.

WHAT YOU'LL DO • Define the architecture for Commerce Factory’s agent learning and feedback systems, including how agents evaluate outcomes, capture quality signals, and improve over time.

• Design feedback and evaluation pipelines that measure agent outcomes, identify meaningful quality signals, and translate those signals into improvements such as prompt and skill updates, routing changes, and reward or preference data.

• Apply AI and machine learning techniques such as preference learning, reward modeling, reinforcement learning, and progress guided by analysis. Select approaches based on the specific problem, expected impact, and operational requirements.

• Define how the Learning Layer integrates with the Agent Harness, evaluation infrastructure, skills layer, tool calling, context management, and execution loop.

• Establish architecture standards and technical direction across Commerce Factory through architecture reviews, design documents, technology evaluations, and build-versus-buy decisions.

• Develop prototypes and proof-of-concepts using current AI models, agent frameworks, training approaches, and evaluation techniques. Evaluate technologies based on their ability to deliver reliable, scalable production capabilities.

• Mentor engineers and contribute to technical development through design reviews, code reviews, architecture guidance, and technical documentation.

• Partner with product, engineering, the broader Agent Harness team, and platform stakeholders to translate business and technical goals into a clear roadmap and executable architecture.

WHAT YOU'LL NEED TO SUCCEED • 12+ years of software engineering experience, including experience designing and architecting AI, ML, or data-intensive systems at scale.

• Experience crafting and delivering LLM and agentic systems, including tool use, context and state management, output evaluation, and improvement based on user input.

• Experience with techniques such as reinforcement learning, preference learning, RLHF, reward modeling, or related approaches, with experience applying these techniques to production systems.

• Experience designing evaluation and learning systems that connect agent actions, measurable outcomes, feedback signals, and system improvements.

• Demonstrated ability to translate ambiguous business or technical objectives into clear architecture, technical strategy, and execution plans.

• Experience applying AI or machine learning to products or platforms, with measurable results such as improved quality, adoption, reliability, productivity, or cost efficiency.

• Experience providing technical leadership through architecture reviews, technical standards, mentoring, or guidance for engineering teams.

• Proficiency in Python and at least one additional programming language.

• Experience with cloud platforms such as AWS or Azure, data pipeline technologies, and ML experimentation infrastructure.

• Ability to collaborate effectively across engineering, product, architecture, and platform teams.

ABOUT THE ROLE This is an opportunity to help define the technical foundation for agentic software development at Adobe. You will influence architecture across Commerce Factory and help establish scalable approaches for agent learning, evaluation, and continuous improvement. Your work will contribute to systems used by engineering teams across Adobe and will help shape how AI-powered development evolves across the organization. Adobe is an equal opportunity employer. We welcome and encourage applications from candidates of all backgrounds.

About Adobe Adobe empowers everyone to create through innovative platforms and tools that unleash creativity, productivity and personalized customer experiences. Adobe’s industry-leading offerings including Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud, Adobe Experience Platform, Adobe Experience Manager, and GenStudio enable people and businesses to turn ideas into impact, powered by AI and driven by human ingenuity.

Our 30,000+ employees worldwide are creating the future and raising the bar as we drive the next decade of growth. We’re on a mission to hire the very best and believe in creating a company culture where all employees are empowered to make an impact. At Adobe, we believe that great ideas can come from anywhere in the organization. The next big idea could be yours. 

Let’s Adobe together At Adobe, we believe in creating a company culture where all employees are empowered to make an impact. Learn more about Adobe life, including our values and culture , focus on people, purpose and community , Adobe for All , comprehensive benefits programs , the stories we tell , the customers we serve, and how you can help us advance our mission of empowering everyone to create.

Adobe is proud to be an Equal Employment Opportunity employer. We do not discri

Similar jobs

• Senior Security Research Scientist — Censys · Remote
• Senior Applied Scientist — Crunchyroll · Los Angeles, California, United States; San Francisco, CA, United States
• Senior Applied Scientist — Garnerhealth · New York City, New York
• Senior Applied Scientist — Qualtrics · Reston, Virginia, United States
• Senior Applied Scientist — Adobe · San Jose
• Senior Scientist — Avantor · Bridgewater, NJ
• Senior+ Applied Scientist — Samsara · Remote
• Senior Research Scientist — Elanco · Indianapolis, IN