Director, Psychometric Operations & Data Governance Job at EdTech Jobs (San Juan)

Job Description

Join College Board as the Director of Psychometric Operations & Data Governance, where you will lead the modernization of data architecture and ensure the ethical management of psychometric and operational data in a hybrid work environment. The Director, Psychometric Operations & Data Governance, is expected to be key architect of CB-LATAM’s data ecosystem—ensuring that psychometric and operational data are managed ethically, governed responsibly, and leveraged to drive both operational excellence and strategic insight.

Job Responsibility

Psychometric Operations Leadership (30%): Drive and safeguard the operational integrity of scoring, equating, calibration, and reporting data workflows
Execute and monitor scoring cycles meet defined turnaround time, accuracy, and QA standards
Design and implement reproducibility, documentation, and traceability standards across all psychometric processes
Architect and implement modernization of legacy scoring and item analysis pipelines into relational or warehouse-based systems
Conduct root-cause analysis for systemic scoring irregularities or data discrepancies
Partner with Psychometricians to ensure form rotation, scaling, and calibration processes are technically sound and operationally resilient
Enterprise Data Governance & Stewardship (25%): Serve as the designated Data Steward for psychometric and operational data within CB-LATAM
Design and operationalize a unified governance framework covering metadata, retention, access control, and data lifecycle management
Maintain comprehensive end-to-end data flow documentation across systems
Ensure compliance with College Board governance policies, professional testing standards (AERA/APA/NCME), and applicable privacy regulations
Establish governance KPIs and risk monitoring mechanisms
Lead audit readiness efforts and documentation processes
Data Architecture & Infrastructure Modernization (20%): Define and execute the roadmap for transitioning from manual, file-based workflows to automated, scalable infrastructure
Partner with Technology to implement secure, cloud-aligned environments for psychometric and scoring data
Establish standards for schema design, lineage tracking, validation routines, and version control
Execute and validate migration of core datasets into governed architecture
Design and validate technical design decisions for new pipelines and automation initiatives
Automation, AI & Advanced Analytics (15%): Lead integration of AI-assisted validation and anomaly detection tools within scoring and integrity review workflows
Establish model governance standards including documentation, benchmarking, and human-review protocols
Identify automation opportunities that reduce manual effort while increasing consistency and quality
Translate complex analytic outputs into executive-ready insights and operational recommendations
Organizational Leadership & Influence (10%): Represent R&M in enterprise data architecture and modernization initiatives
Mentor team members in governance, reproducible research practices, and advanced analytics
Advise senior leadership on data risk, infrastructure investments, and operational priorities
Promote a culture of accountability, data ethics, and continuous improvement

Requirements

Master’s degree in Data Science, Computer Science, Statistics, Information Systems, Psychometrics, or related field
8–12+ years of experience in data architecture, governance, analytics leadership, or high-stakes operational data environments
Demonstrated experience owning production data systems with strict accuracy and compliance requirements
Proven track record implementing data governance frameworks and automation strategies
Strong technical fluency in SQL and at least one programming language (R or Python)
Experience designing or operating data workflows within AWS cloud infrastructure and working with structured and semi-structured data formats (e.g., JSON)
Working knowledge of IRT and CTT models, scaling, and equating procedures
Experience deploying AI/ML models into operational workflows
Strong executive communication and stakeholder alignment skills
Ability to travel 1-2 times a year to College Board offices or on behalf of College Board business
Bilingual proficiency in Spanish and English
Resident in USA, Authorization to work in the United States for any employer

EdTech Jobs - All Job Offers

Select Country

Director, Psychometric Operations & Data Governance

Job Description

Job Responsibility

Requirements

Looking for more opportunities?

Director, Psychometric Operations & Data Governance

IT Training Lead

K Kitchen Representative

K Kitchen Representative

Restaurant Assistant Manager

Plant Operator - Crushing and Screen

Graduate Student Instructors

Shift Supervisor

Shift Supervisor

Our AI answers in your language