Subject Matter Expert/Task Lead

• Lead technical solution implementation and system-level ST&E activities across AI/ML models, datasets, and operational mission environments.
• Develop mission-driven evaluation methodologies, test plans, assessment criteria, and operational test scenarios aligned with customer requirements.
• Oversee parallel evaluation efforts spanning multiple AI/ML technologies, mission datasets, and operational constraints.
• Provide technical leadership and guidance to engineers, scientists, and evaluation teams supporting AI/ML testing initiatives.
• Conduct technical reviews, performance assessments, and operational readiness evaluations.
• Coordinate with stakeholders, mission partners, and technical teams to align evaluation outcomes with mission objectives.
• Adapt evaluation approaches to evolving model types, data conditions, operational tempos, and emerging mission needs.
• Identify performance gaps, operational risks, and system limitations prior to fielding to support informed deployment decisions.
• Deliver actionable evaluation findings, technical recommendations, and customer briefings that support model selection, deployment, and refinement activities.

• 10 or more years of experience supporting Test & Evaluation (T&E), System Test & Evaluation (ST&E), or mission-focused operational assessments.
• Experience supporting multidisciplinary technical teams in government, DoD, or Intelligence Community environments.
• Ability to support complex technical evaluations involving AI/ML systems, mission applications, or operational technologies.
• Strong written and verbal communication skills with experience delivering technical briefings and recommendations to stakeholders.

• Experience supporting NGA, DoD, or Intelligence Community mission environments.
• Familiarity with AI/ML model evaluation, operational testing, and mission performance assessment methodologies.
• Experience working in Agile development and DevSecOps environments.
• Familiarity with cloud technologies and AI-enabled mission systems.
• Experience supporting operationally representative testing environments and mission-focused technology integration efforts.

• PhD in Mathematics or STEM related field, or additional relevant experience in lieu of a degree.

• Active TS/SCI clearance and the ability to pass a CI polygraph within 30 days.

• 
  
  
  
  Interesting Work:
  
  
  
  Our co-workers support some of the most important and critical programs to our national defense and security.
  
  
• 
  
  
  
  Values:
  
  
  
  Our first core value is that employees come first. We challenge our co-workers to provide the highest level of support and service, and reward them with some of the best benefits in the industry.
  
  
• 
  
  
  
  100% Employee Owned:
  
  
  
  We have a stake in each other's success, and the success of our customers. It's also nice to know what's going on across the company; we have company wide town-hall meetings three times a year.
  
  
• 
  
  
  
  Great Benefits - Most Full-Time Staff Are Eligible for:
  
  
  




• 
  Starting PTO accrual of 20 days PTO/year + 10 holidays/year
  
• 
  Flexible schedules
  
• 
  6% 401k match with immediate vesting up to $9k annually
  
• 
  Semi-annual bonus eligibility (July and December)
  
• 
  Company funded Employee Stock Ownership Plan (ESOP) - a separate qualified retirement account
  
• 
  Up to $10,000 in annual educational reimbursement
  
• 
  Other company funded benefits, like life and disability insurance
  
• 
  Optional zero deductible Blue Cross/Blue Shield health insurance plan
  




• 
  
  
  
  Track Record of Success:
  
  
  
  We have grown every year since our founding in 1993.
  
  

Modern Technology Solutions, Inc. (MTSI) is a 100% employee-owned engineering services and solutions company that provides high-demand technical expertise in Digital Transformation, Modeling and Simulation, Rapid Capability Development, Test and Evaluation, Artificial Intelligence, Autonomy, Cybersecurity and Mission Assurance

MTSI delivers capabilities to solve problems of global importance. Founded in 1993, MTSI today has employees at over 20 offices and field sites worldwide.

For more information about MTSI, please visit www.mtsi-va.com