Senior Principal Software Engineer - AI Governance

About this role

Strength in Trust

OneTrust’s mission is to enable innovation through the responsible use of data and AI. We believe that ensuring data is trusted shouldn’t slow teams down—it should accelerate what’s possible. This led us to develop the first technology platform for responsible data use in 2016. Today, with AI representing the latest and most impactful expansion of data yet, OneTrust is once again redefining what responsible innovation looks like. OneTrust, the AI‑Ready Governance Platform™, unifies regulatory intelligence, automation, and connected governance workflows so businesses can continue to move at the speed of AI while ensuring good governance to prevent data misuse at scale. Trusted by thousands of organizations worldwide, OneTrust is shaping the future where trusted data becomes a transformative force for business and society.

The Challenge

As a Senior Principal Software Engineer, you will serve as a technical leader for OneTrust’s AI Governance platform, driving the design, scalability, and reliability of systems that enable enterprises to deploy and govern AI and LLM-powered applications responsibly. You will deeply understand how customers build, deploy, and operate AI systems, and translate those needs into secure, compliant, and observable platform capabilities.

Your Mission

Development

• Lead the design and development of Java/Python microservices and shared libraries integrating with AI platforms for OneTrust’s AI Governance product.

• Design, build, and test cloud-native applications deployed on Microsoft Azure using Core Java, REST, and the Spring ecosystem.

• Build features with RAG, agent workflows, and model orchestration.

• Own technical design for critical systems, ensuring scalability, security, and reliability.

• Maintain strong automated unit/integration test coverage and engineering standards. Achieve at least 80% code coverage or per the revised standards set by the team

Collaboration

• Work closely with UX, Product Managers and/or Product Owners, as well as other developers to contribute to planning and grooming sessions and drive team’s discussions on system architecture and component design. 

• Partner with Product, UX, and Customer Success to understand customer AI use cases and governance needs.

• Lead architecture discussions and technical planning.

• Drive alignment across teams on platform design and priorities.

• Contribute to sprint planning and delivery.

Support

• Reduce defects by identifying and addressing issues early in the development lifecycle.

• Ensure critical and high priority CII’s are delivered per SLA.

• Promote early defect detection through strong design and testing.

• Improve system monitoring, resilience, and operational maturity.

Code Review

• Set standards for clean, secure, and maintainable code.

• Conduct thorough reviews for distributed and AI-enabled systems.

• Guide engineers on testing, automation, and AI system validation.

Lead

• Help build high-performing teams by mentoring the team on new technical skills.

• Influence technical strategy and long-term platform direction.

• Build a culture of ownership, learning, and engineering excellence.

You Are

A senior technical leader with strong system design and hands-on execution skills, who understands how enterprises use AI and LLMs in real-world workflows and can translate those needs into scalable, secure, and compliant platform solutions.

Your Experience Includes

• Bachelor's or master's degree in computer science, Engineering, or related technical or business field.

• 12+ years of professional software engineering/development experience

• Strong expertise in Java/J2EE, Spring, design patterns, microservices architecture, and cloud-native distributed systems

• Proven experience building production-grade agentic AI systems with robust tool-use, guardrails, and observability for enterprise-scale workloads.

• Solid understanding of RAG pipelines, agent workflows, model orchestration, and evaluation practices.

• Working experience with one or more AI platforms like Amazon SageMaker, Google Vertex, AWS Bedrock etc.

• Experience with elastic search and data streaming tools like Kafka.

• Good understanding of web services and SOA related standards like REST/OAuth/JSON.

• Moderate understanding of code and script (Python, Bash)

• Good experience with SQL and NoSQL databases

• Agile development (Scrum, XP, or Pair Programming) experience

• Ability to use a wide variety of open-source technologies and cloud services.

• Familiarity with public cloud providers such as (Azure, Google Cloud, or AWS)

Extra Awesome

• Experience with different databases (Relational and document) is a strong asset.

• Familiarity with continuous integration and continuous deployment (CI/CD) tools.

• Proficiency in Kubernetes, including cluster deployment, scaling, and management is highly desirable.

• Background in enterprise, regulated, or security-focused environments.

For California, Colorado, Connecticut, Nevada, New York, Rhode Island, and Washington-based candidates: the annual base pay range for this role is listed below. Within this range, individual pay is determined by several factors, including location, job-related skills, work experience, and relevant education and/or training. This role may also be eligible for discretionary bonuses, equity, and/or commissions, as well as benefits.

Salary Range $165,000 — $247,500 USD

Where we Work

We are embracing an office-first culture, encouraging three days a week in office for most roles, with meaningful opportunities to collaborate and celebrate in person.

Each role may have specific requirements or flexibility depending on the scope of the position, so we encourage you to verify this with your recruiter during your first interview.

Benefits

As an employee at OneTrust , you will be part of the OneTeam . That means you’ll receive support physically, mentally, and emotionally so that you can do y

Similar jobs

• Senior Manager, Software Engineering - AI — Netdocuments · Remote
• Senior Engineering Manager, AI Quality & Governance — Mitratech · Remote
• Senior Compliance Engineer, AI Governance — Trueanomalyinc · Denver, CO or Long Beach, CA or Washington, DC or SF Bay Area, CA
• Senior Software Engineer - AI Engineering — Mercury · Remote
• Staff Software Engineer - AI Governance Integrations — Onetrust · Atlanta, Georgia
• Senior Software Engineer (AI) — Junipersquare · Remote
• Senior Software Engineer, AI — August-health · Remote
• Principal Software Engineer, AI — Salesloft · Remote