Senior AI Applied Engineer

About this role

Become a part of our caring community   Most AI engineering jobs are a thin wrapper around a model API. This role is different.

We build the platform that transforms millions of clinical documents into trusted, actionable data. Our systems use large language models (LLMs) to read medical records, extract structured facts, answer complex questions with citations back to the source document, and route ambiguous cases to human experts for review.

Our users make decisions that impact real healthcare outcomes, so “good enough” is not good enough. Building AI systems that are accurate, reliable, auditable, and scalable is at the core of this role.

As a Senior AI Applied Engineer, you will design, build, deploy, and operate production AI systems used at scale within one of the largest health insurers in the United States. You will own solutions end-to-end, from user experience and APIs to model orchestration, evaluation frameworks, infrastructure, and production operations.

Why Join Us • Build production AI systems where LLMs are in the critical path, not just demos or proofs of concept.

• Work on extraction, retrieval, agentic workflows, and human-review systems that process real healthcare data at scale.

• Own projects end-to-end across frontend, backend, AI orchestration, infrastructure, deployment, and operations.

• Solve challenging problems around accuracy, explainability, traceability, and reliability in regulated environments.

• Ship quickly in a small, high-impact team that embraces AI-assisted development and rigorous quality standards.

• Build systems that continuously improve through expert feedback, evaluations, and human-in-the-loop workflows.

Key Responsibilities • Design, develop, and deploy full-stack AI-powered applications, including frontend experiences, APIs, backend services, and data pipelines.

• Build and optimize LLM-based workflows for information extraction, classification, retrieval, summarization, and agentic processes.

• Develop robust prompt strategies, structured output frameworks, tool-calling capabilities, and fallback mechanisms to improve reliability.

• Design and implement retrieval-augmented generation (RAG) systems using embeddings, vector databases, and semantic search technologies.

• Build evaluation frameworks, including benchmark datasets, regression testing, quality metrics, and human review workflows.

• Develop human-in-the-loop processes that enable clinicians and domain experts to validate AI outputs and provide feedback for continuous improvement.

• Build and maintain document-processing pipelines, including OCR, document ingestion, metadata extraction, indexing, and search capabilities.

• Optimize AI systems for accuracy, latency, reliability, scalability, and cost efficiency.

• Implement observability, monitoring, logging, alerting, and incident response processes for production systems.

• Deploy and operate services in cloud-native environments using Kubernetes, Docker, CI/CD pipelines, and modern infrastructure tooling.

• Collaborate with product, engineering, clinical, and operational stakeholders to translate complex business requirements into scalable solutions.

• Ensure solutions meet privacy, security, compliance, and auditability requirements within a regulated healthcare environment.

Use your skills to make an impact   Required Qualifications • Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.

• 5+ years of experience building and operating production software systems.

• Experience developing backend services, APIs, distributed systems, or data-intensive applications.

• Hands-on experience integrating LLMs into production applications beyond simple chat interfaces, including structured outputs, tool calling, retrieval-augmented generation (RAG), agents, or multi-step workflows.

• Experience with at least one major AI platform or model provider such as OpenAI, Anthropic, Google, Azure AI, or AWS Bedrock.

• Strong programming skills in Python and/or TypeScript/JavaScript.

• Experience debugging, monitoring, and supporting production applications used by real customers.

• Ability to work independently, navigate ambiguity, and take ownership of projects from concept through deployment.

Preferred Qualifications • Experience building AI systems where LLMs are part of the critical production workflow.

• Experience designing evaluation frameworks, testing strategies, prompt versioning, tracing, and model performance monitoring.

• Experience with agentic architecture, Model Context Protocol (MCP), tool orchestration frameworks, or autonomous workflows.

• Experience with React, Next.js, modern frontend development, and full-stack application architecture.

• Experience deploying and operating workloads in Kubernetes, Docker, and cloud environments.

• Experience with modern CI/CD practices and infrastructure automation.

• Experience working in regulated industries such as healthcare, financial services, or government.

• Familiarity with privacy, compliance, governance, and data protection requirements.

• Experience using AI-assisted development tools to improve engineering productivity and software quality.

• Strong problem-solving, communication, and collaboration skills.

Success in This Role Successful candidates are energized by ambiguity, motivated by ownership, and excited to solve difficult problems where correctness matters. You enjoy building systems that are accurate, traceable, and trustworthy, and you view model failures as engineering challenges to be solved rather than limitations to be accepted. This role is best suited for engineers who want to own meaningful problems end-to-end and see their work directly impact on users and business outcomes.

Technology Stack • TypeScript

• React / Next.js

• Python

• PostgreSQL

• Gemini on Vertex AI

• OCR and Document AI technologies

• Docker

• Kubernetes

• Modern CI/CD platforms and

Similar jobs

• Senior AI Engineer — "Headquartered in Arlington · Dahlgren, VA
• Senior AI Engineer — Elevance Health · GA-ATLANTA, 740 W PEACHTREE ST NW
• Senior AI Engineer — Cadence · SAN JOSE
• Senior AI Engineer — Pragmatike · Remote
• Senior AI Engineer — GE Appliances · KY, Louisville
• Senior AI Engineer — Finastra · Atlanta
• Senior AI Engineer — Acrisure · TX
• Senior AI Engineer — Brown Brothers Harriman (BBH) · Boston | Jersey City | New York