Lead Psychometrician

Organization NameJob CategoriesPosition TypeRegion and Location(s)Career LevelSalaryAd Online SinceApplication Deadline
Canadian Alliance of Physiotherapy Regulators
  • Research
Full Time
  • Ontario - Metro Toronto Area - Toronto
Experienced (Non-manager)$125,000 - 145,0002019-01-072019-02-25



SALARY RANGE: $125,000 - $145,000 (prorated) 


The Canadian Alliance of Physiotherapy Regulators (CAPR) is the pan-Canadian federation of provincial and territorial physiotherapy regulators whose mission it is to support the physiotherapy community in protecting the public.  CAPR assesses the education and qualifications of all internationally-educated physiotherapists; it administers the national Physiotherapy Competency Exam for all candidates, whether Canadian-educated or internationally-educated; and it supports Canadian physiotherapy regulators through knowledge brokering and policy services. 

The Lead Psychometrician oversees and leads psychometric activities related to the development, delivery and assessment of the Physiotherapy Competency Examination (PCE) – both written and clinical components.  Working closely with the Manager of Exam Development and the Manager of Exam Delivery and Operations, this position provides leadership in the assessment of the performance of the PCE including scoring, standard setting, equating, item and test analysis and results reporting.  The psychometrician provides advice on examination principles and best practices in assessment methodologies, standards, and program evaluation, and ensures that the PCE is defensible and adheres to generally accepted measurement principles.  Other key responsibilities include identifying and providing guidance in improvements to the design and delivery of the PCE.  This includes providing oversight to outsourced agencies that provide external psychometric contracted services regarding statistical analysis.  

The psychometrician provides interpretation, advice and support to the Leadership Team, Registrars, the Board of Directors and the Committees of the Board.  This position shares assessment expertise and interpretation with a number of CAPR’s external stakeholders including the Canadian Council of Physiotherapy University Programs.   


 The Lead Psychometrician:

  • Analyzes and prepares exam data sets and creates academic, candidate and regulator reports after each written and clinical exam
  • Proactively reviews exam data to identify relevant trends or hotspots to inform additional analyses work or targeted research
  • Provides psychometric advice on key initiatives i.e.) implementation of new Blueprint; continuous review and improvement for the clinical component of the PCE; inter-rater reliability for Examiners; improvements in item generation
  • Analyzes credentialing data on internationally educated physiotherapists
  • Develops Annual Academic Reports for physiotherapy faculty of Canadian Universities whose students take the PCE
  • Provides psychometric interpretation to CAPR’s Committees (Board of Examiners, Evaluation Services, Clinical Test Development, Written Test Development).
  • Provides guidance to staff on best practices in psychometrics and credentialing.
  • Provides leadership to CAPR’s external Psychometric Advisory Panel
  • Presents research related to CAPR activities at professional conferences
  • Conducts other regular or ad-hoc analytical work using credentialling and exam data as needed


  • 5 years plus of experience in managing the development and delivery of examinations for credentialing purposes (certification and/or licensure)
  • Proficiency in psychometric methods, statistical procedures and research design
  • Ph.D. in testing and measurement and/or psychometrics, Education, Educational Psychology, Quantitative Psychology, Social Sciences, or related field
  • Proven ability to identify, analyze and provide recommendations for corrective actions for problems in test development and/or administration
  • Exceptional skills in designing, conducting, summarizing and presenting results of psychometric analyses
  • Ability to explain psychometric concepts and decisions to a lay audience so that effective credentialing decisions can be made
  • Excellent written and verbal communication and presentation skills
  • Excellent interpersonal skills; ability to work well in a team environment and collaborate to meet timelines and deliverables for exam development and delivery
  • French language an asset

CAPR is committed to fair and accessible employment practices and we are committed to providing accommodations for persons with disabilities. If you require accommodations to apply for this opportunity, require this posting in an additional format, or if contacted for an interview and require accommodation during any stage of the recruitment process, please contact us at the email below. We will work with all applicants to determine appropriate accommodation for individual accessibility needs.

DEADLINES FOR APPLICATIONS: Monday, February 25, 2019 by 4:30 p.m.

We thank all applicants for their interest in this opportunity, however; only those under consideration will be contacted.

For more information, please visit our website at www.alliancept.org

Please use the Apply Now button below
to be considered for this position.

Apply NowThis functionality is only available on a desktop or laptop computer.

Click here for important information about
applying for a job through CharityVillage.