New

Language Evaluation Project Manager

TEKsystems
$45.00 - $55.00 / hr
life insurance, sick time, 401(k), retirement plan
United States, Texas, Austin
Jun 07, 2025
Job Description: Our client is looking for a Language Evaluation Project Manager. This role will focus on planning, executing, and analyzing evaluation projects across multiple languages and content types to ensure language assets meet the highest standards of quality. The role will support quality driven projects, ensuring adherence to established metrics and standards through quality control processes, for AI/ML and human-translated/localized content. Strong organizational skills, effective project management, and data-driven decision-making for continuous improvement. Qualifications: * Knowledge of localization industry quality control processes and procedures * Experience with AI/ML evaluations and prompt quality measurement. * Experience developing linguistic assets such as style guides and training modules. * Second language proficiency is preferred but not required. Responsibilities/Deliverables: * Plan, scope, and execute evaluation projects for AI/ML and human-translated/localized content * Support evaluation goals, track timelines & KPIs * Ensure the right workflows, resources, and tools are in place to ensure on-time and high-quality delivery * Track and report progress and results * Refine evaluation methodologies as needed (e.g., dimensions, fluency ratings, MQM, TER, Golden datasets etc.) * Develop training plan & guidelines for evaluations suppliers for consistent and reliable assessments * Support in customizing evaluation processes depending on language pair, content type, or use case Data Analysis & Reporting: * Analyze evaluation results and generate actionable insights and recommendations * Coordinate with suppliers on benchmarking and quality assessments needs * Conduct and support supplier quality audits, managing quality arbitration processes and vendor KPI reviews to ensure compliance * Compare AI/ML outputs against human translations for quality, consistency, and feasibility * Provide data-driven guidance to improve model training or vendor selection * Support the implementation of corrective actions and continuous improvement initiatives. * Help maintain documentation and version control for quality standards, glossaries, and test cases. * Test and perform user acceptance testing (UAT) for quality-related tool enhancements and features. Pay and Benefits The pay range for this position is $45.00 - $55.00/hr. Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following: * Medical, dental & vision * Critical Illness, Accident, and Hospital * 401(k) Retirement Plan - Pre-tax and Roth post-tax contributions available * Life Insurance (Voluntary Life & AD&D for the employee and dependents) * Short and long-term disability * Health Spending Account (HSA) * Transportation benefits * Employee Assistance Program * Time Off/Leave (PTO, Vacation or Sick Leave) Workplace Type This is a hybrid position in Austin,TX. Application Deadline This position is anticipated to close on Jun 11, 2025. About TEKsystems and TEKsystems Global Services We're a leading provider of business and technology services. We accelerate business transformation for our customers. Our expertise in strategy, design, execution and operations unlocks business value through a range of solutions. We're a team of 80,000 strong, working with over 6,000 customers, including 80% of the Fortune 500 across North America, Europe and Asia, who partner with us for our scale, full-stack capabilities and speed. We're strategic thinkers, hands-on collaborators, helping customers capitalize on change and master the momentum of technology. We're building tomorrow by delivering business outcomes and making positive impacts in our global communities. TEKsystems and TEKsystems Global Services are Allegis Group companies. Learn more at TEKsystems.com. The company is an equal opportunity employer and will consider all applications without regard to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.