Artificial Intelligence / Machine Learning Verification and Validation Engineer

About this role

APPLICATION INSTRUCTIONS: • CURRENT PENN STATE EMPLOYEE (faculty, staff, technical service, or student), please login to Workday to complete the internal application process . Please do not apply here, apply internally through Workday.

• CURRENT PENN STATE STUDENT (not employed previously at the university) and seeking employment with Penn State, please login to Workday to complete the student application process. Please do not apply here, apply internally through Workday.

• If you are NOT a current employee or student, please click “Apply” and complete the application process for external applicants .

Approval of remote and hybrid work is not guaranteed regardless of work location. For additional information on remote work at Penn State, see  Notice to Out of State Applicants .

​     POSITION SPECIFICS ​ We are searching for a talented, experienced, organized, detail-oriented, and highly motivated AI/ML Engineer to join our Independent Verification and Validation (IV&V) and Data Curation Center of Excellence in the Information Science Division within the All-Domain Analytics and Signatures Office (A2SO) at the Applied Research Laboratory (ARL).  This team serves as the foundation for effective machine learning—building, curating, and governing the data that directly determines whether AI/ML models succeed in operationally relevant environments.  You will focus on hands-on work with classified multi-modal data, including imagery/FMV, geospatial and AIS tracks, signals and sensor data, and text-based intelligence reports and develop pipelines, annotation frameworks, and quality assurance processes while gaining deep exposure to state-of-the-art AI/ML research.

ARL is an authorized DoD Skillbridge partner and welcomes all transitioning military members to apply.

You will: • Label, annotate, and curate multi-modal datasets (imagery/FMV, geospatial, signals, text/documents) to support AI/ML model development and evaluation • Design and implement data pipelines for ingestion, transformation, quality control, and cataloging of classified and open-source data • Develop and maintain annotation standards, labeling guidelines, and data governance processes to ensure consistency and reproducibility across projects • Conduct IV&V of datasets and model outputs to ensure data integrity, label accuracy, and fitness for intended use • Collaborate with research scientists, algorithm developers, and program stakeholders to identify, acquire, and prioritize data requirements for specific AI/ML projects • Build and maintain data catalogs, metadata schemas, and access-controlled repositories that make curated datasets discoverable and accessible to the broader research team • Employ Python, SQL, and annotation platforms (e.g., CVAT, Label Studio) to automate labeling workflows, perform exploratory data analysis, and develop quality metrics • Document data provenance, lineage, and known limitations to support model evaluation, reproducibility, and responsible AI practices • Collaborate within an Agile development environment as part of a large research team

Required Skills/Experience areas include: • Bachelor's Degree in Computer Science, Data Science, Information Science, Engineering, or a related technical field • Proficiency in Python and SQL for data manipulation, analysis, and pipeline development • Familiarity with data annotation tools and workflows (e.g., CVAT, Label Studio, or equivalent) • Understanding of machine learning concepts, including how data quality impacts model training, evaluation, and deployment

Preferred Skills/Experience areas include: • Experience working with DoD or Intelligence Community data, workflows, or operational environments • Familiarity with geospatial data formats (shapefiles, GeoJSON, AIS), imagery/FMV exploitation, or signals data processing • Experience with data versioning tools (e.g., DVC, LakeFS) or data catalog platforms • Knowledge of IV&V methodologies and quality assurance practices for data-driven systems • Exposure to containerized development environments (Docker, Kubernetes) and cloud platforms (AWS, Azure) • Current eligibility for access to classified information at the TS/SCI level or higher and may be subject to a government background investigation to upgrade clearance eligibility, if required

Your working location will be fully on-site, located in State College, PA or Reston, VA .  Questions related to flexible work should be directed to the hiring manager during the interview process.   MINIMUM EDUCATION, WORK EXPERIENCE & REQUIRED CERTIFICATIONS If filled as R&D Engineer - Artificial Intelligence (ARL) - Advanced Professional, this position requires:
Bachelor's Degree - Engineering or Science
5+ years of relevant experience
Required Certifications:
None

If filled as R&D Engineer - Artificial Intelligence (ARL) - Intermediate Professional, this position requires:
Bachelor's Degree - Engineering or Science
2+ years of relevant experience
Required Certifications:
None

If filled as R&D Engineer - Artificial Intelligence (ARL) - Professional, this position requires:
Bachelor's Degree - Engineering or Science
No prior relevant work experience required
Required Certifications:
None   ARL’s purpose is to research and develop innovative solutions to challenging scientific, engineering, and technology problems in support of the Navy, the Intel Community (IC), and other federal government customers.

FOR FURTHER INFORMATION on ARL, visit our website at  www.arl.psu.edu .   BACKGROUND CHECKS/CLEARANCES Employment with the University will require successful completion of background check(s) in accordance with University policies.   Notice regarding employment at the Applied Research Laboratory (ARL):
Employees must be eligible to obtain a government security clearance, participate in the ARL drug testing program, and comply with electronic and physical monitoring requirements applicab

Similar jobs

• Artificial Intelligence / Machine Learning Lead Verification and Validation Engineer — Penn State University · Reston, VA
• Artificial Intelligence / Machine Learning Research and Development Engineer — Penn State University · Reston, VA
• Artificial Intelligence Machine Learning Engineer 2 — Captivation · Annapolis Junction, MD
• Principal AI/ML Engineer, Validation Strategy & Test Architecture — Micron · Longmont-MAX- Office, CO | Boise, ID - Main Site
• Senior AI Machine Learning Engineer — Thehartford · Columbus, OH | Hartford, CT | Charlotte, NC
• Senior AI Machine Learning Engineer — Thehartford · Remote
• Sr AI Machine Learning Engineer — Thehartford · Remote
• Senior Software Verification & Validation Engineer — Draper · Cambridge, MA