ForgeApplyTry it free

ForgeApply · Job listing

Sr. Technical Analyst, Agentic AI

Johnson & Johnson

Raritan, NJ, US$94k – $152khybrid

See all 634 open roles at Johnson & Johnson →

Tailor your resume for this Johnson & Johnson job in about a minute.

ForgeApply tailors your resume and cover letter to this exact posting, then hands you a ready-to-submit application for Johnson & Johnson's site. Free trial, no card required.

Tailor my resume for this jobView original posting →

About this role

At Johnson & Johnson, we believe health is everything. Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments are smarter and less invasive, and solutions are personal. Through our expertise in Innovative Medicine and MedTech, we are uniquely positioned to innovate across the full spectrum of healthcare solutions today to deliver the breakthroughs of tomorrow, and profoundly impact health for humanity. Learn more at jnj.com

As guided by Our Credo, Johnson & Johnson is responsible to our employees who work with us throughout the world.  We provide an inclusive work environment where each person is considered as an individual.  At Johnson & Johnson, we respect the diversity and dignity of our employees and recognize their merit.

Job Function: Technology Product & Platform Management

Job Sub Function: Technical Product Management

Job Category: Scientific/Technology

All Job Posting Locations: Raritan, New Jersey, United States of America

Job Description:

We are searching for the best talent for a Sr. Technical Analyst, Agentic AI to be located in Raritan, NJ

MedTech R&D IT – Data and AI, Lead Analyst – Agentic AI (Document Generation & Cognitive Search)

Position Summary We are seeking a Product Lead Analyst with deep expertise in agentic AI systems to drive the design, delivery, and continuous improvement of autonomous document-generation and cognitive-search platforms. This role operates at the intersection of product analysis, AI/ML solution delivery, and enterprise content workflows. The ideal candidate is an agentic AI expert who understands how to orchestrate large language models, retrieval-augmented generation pipelines, and multi-step reasoning agents to produce consistent, traceable, review-ready outputs at scale.

Agentic Document Generation ·         Own the product backlog and roadmap for agentic document-generation solutions that autonomously draft technical, regulatory, and compliance documents from source evidence ·         Design and refine reusable prompt templates, agent workflows, and orchestration logic that drive source-document ingestion, multi-step reasoning, and output composition with full section-level traceability ·         Define acceptance criteria ensuring generated drafts are consistent, citation-accurate, and traceable to source documents for human expert review and approval ·         Collaborate with domain stakeholders to onboard new document-generation use cases, validate output quality, and expand platform coverage

Agentic Cognitive Search ·         Own the product backlog for agentic cognitive-search platforms that go beyond keyword lookup – interpreting intent, reasoning across documents, and synthesizing cited answers ·         Define and validate natural-language query experiences where every statement in the synthesized answer is cited to its source document ·         Manage requirements for modular search capabilities including evidence retrieval, lifecycle intelligence, and domain-specific search agents ·         Ensure role-based access governance so synthesized answers respect the permissions held on underlying source documents Product Analysis & Delivery Execution ·         Drive end-to-end delivery of agentic AI features including sprint planning, release readiness, and go/no-go criteria ·         Translate business requirements into user stories, detailed specifications, and acceptance criteria for engineering teams building agent pipelines ·         Coordinate cross-team dependencies, conduct change-impact analysis, and manage risk/milestone tracking across multiple agentic workstreams

AI/ML Platform Operations & Quality ·         Monitor output quality of AI-generated content and search answers; define feedback loops, guardrails, and continuous-improvement metrics ·         Support incident and problem management for agent orchestration, LLM performance, retrieval accuracy, and hallucination detection ·         Contribute to observability improvements including citation-accuracy scoring, traceability audits, prompt-performance benchmarking, and agent-step telemetry

Compliance & Governance ·         Ensure agentic AI outputs adhere to applicable quality-system, validation, and regulatory requirements ·         Maintain audit-ready traceability artifacts demonstrating every generated section is linked to its source evidence ·         Support responsible-AI practices including bias monitoring, content safety, and ethical use of generative models

Stakeholder Engagement & Expansion ·         Collaborate with business, regulatory, clinical, quality, and engineering teams to expand agentic platform adoption ·         Drive onboarding of new document-generation and cognitive-search use cases across business units

Technical Skills & Domain Knowledge ·         Agentic AI & Orchestration: Multi-agent frameworks (LangGraph, CrewAI, AutoGen, or equivalent), tool-use patterns, chain-of-thought reasoning, planning/reflection loops, agent memory and state management ·         LLM & NLP: Large Language Models (GPT, Claude, open-source), prompt engineering, fine-tuning, Retrieval-Augmented Generation (RAG), semantic chunking, embedding models ·         Search & Retrieval: Vector databases (Pinecone, Weaviate, OpenSearch), semantic search, hybrid search (BM25 + vector), re-ranking, knowledge graphs ·         Cloud & Infrastructure: AWS (Bedrock, S3, Lambda, Step Functions, SageMaker), or equivalent cloud AI services; API design and integration patterns ·         Document & Content Platforms: PLM systems (e.g., Windchill), document management, content extraction/parsing, regulatory submission workflows ·         Evaluation & Observability: LLM evaluation frameworks (RAGAS, DeepEval, or equivalent), tracing (LangSmith, Arize), hallucination detection, citation validation

Qualifications Required: ·         5–8+ years in product/business analysis within technology,

Tailor your resume for this Johnson & Johnson role before you apply.

Tailor my resume for this job

Similar jobs

Free ATS checker · How to Tailor Your Resume to a Job Description (Step by Step)