Psychometrician

Organization NameJob CategoriesPosition TypeRegion and Location(s)Career LevelSalaryAd Online SinceApplication Deadline
The College of Family Physicians of Canada
  • Management / Executive
Full Time
  • Ontario - Peel Region - Mississauga
Manager (Supervisor of Staff)N/A2019-11-272020-01-08
2019-24

About the CFPC

Representing more than 37,000 members across the country, the College of Family Physicians of Canada (CFPC) is the professional organization responsible for establishing standards for the training, certification and lifelong education of family physicians and for advocating on behalf of the specialty of family medicine, family physicians and their patients. The CFPC accredits postgraduate family medicine training in Canada’s 17 medical schools.

Our Mission: Leading family medicine to improve the health of all people in Canada—by setting standards for education, certifying and supporting family physicians, championing advocacy and research, and honouring the patient-physician relationship as being core to our profession.

Our Vision: Leading family medicine. Improving lives.

Our Values: Caring; Learning; Collaboration; Responsiveness; Respect; Integrity; and Commitment to Excellence.

 

We are recruiting for a Psychometrician

 

Posting #:            2019-24

Department:      Certification & Assessment

Division:              Academic Family Medicine (AFM)            

Reports to:         Director, Certification & Examinations                                   

Classification:    Management

Status:                 Permanent, Full time

*FTE:                     1             

Level:                    7                             

Job Summary:

The Psychometrician works with the Director - Certification & Assessment, managers – Certification and Assessment, and the Board of Examinations and Certification to ensure the assessment processes leading to the certification decisions of the College of Family Physicians of Canada are valid, fair, defensible, technically appropriate and following current best practices. 

Duties and Responsibilities:

Tasks related to Examination Operations

  • Ensure operational decisions regarding assessment processes are evidence-informed
  • Ensure modeling of various scenarios of operational possibilities occur when needed to allow for decisions with reasonably predictive outcomes
  • Apply best psychometric principles to ensure validity and reliability of our point-in-time examinations including but not limited to standard setting, marking schemes, equating, examination form construction
  • Develop and oversee the production of technical reports on the performance of the point-in-time examinations
  • Develop and oversee the production of candidate statements of results and associated information to guide in the interpretation of statements of results
  • Develop and oversee the production of reports for secondary users and associated information to guide in the interpretation of such secondary reports
  • Work collaboratively to ensure the strategic aims of the Department of Certification & Assessment, the Division of Academic Family Medicine, and the College of Family Physicians of Canada are met
  • Generate reports to educate and inform the Board of Examiners about best psychometric options to allow the committee to make evidence-informed decisions and recommendations
  • Works with and directs the Data Management and Research Analyst
  • Works to educate and inform committees in the Department of Certification & Examinations about best psychometric approaches and, if needed, options to consider

Quality improvement

  • Plan and execute a research agenda designed to assess and strengthen the validity of the examinations, especially when considering decisions pertaining to the minimally competent candidate
  • Work to ensure a scholarly approach is taken to research questions that arise
  • Engage with the Education and Evaluation Research Unit (EERU) to produce collaborative work
  • Engage with other Canadian organizations that undertake medically related assessments to share best practices and learn new approaches
  • Explore and propose new examination-format options that strengthen the Certification decisions, especially the confidence of decisions related to minimally competent candidates
  • Present scholarly work at appropriate conferences

Work Placed Based Assessments

  • Develop and enhance strategies aimed at strengthening the validity of decisions made by programs to recommend candidates to sit a CFPC point-in-time examination
  • Develop and enhance strategies aimed at strengthening the validity of decisions made about practice-eligible route candidates to sit a CFPC point-in-time examination
  • Work to ensure highest quality certification decisions can be made

General tasks

  • Works collaboratively with other staff to strengthen assessment processes within the Department of Certification & Assessment ensuring alignment with the objectives of the Division of Academic Family Medicine
  • Works closely with the Director, Certification & Assessment, other AFM Directors, and Managers to align with and advance the strategic priorities of the CFPC
  • Prepare reports, graphs, briefs, presentations and other modules for reference and submission to the senior level management
  • Works collaboratively with pertinent committees, working groups, managers and others to enable the deliverables of Certification & Assessment division’s projects and priorities
  • Creation of proposals, progress reports, backgrounders, schedules, and timelines when indicated and as required
  • Communicates interdepartmentally and acts as liaison for inter and intra-divisional projects and activities.
  • Communicates when necessary and appropriately with committee members, training programs and other organizations
  • Project management
  • Conducts background research related to project development
  • Organizes and participates in meetings.

Related Duties:

  • Provide excellence in member and customer service
  • Ensure effective and professional communications with all internal/external contacts
  • Develop and maintain collaborative relationships at all levels of the organization in order to build trust and confidence in the services provided
  • Participate with the onboarding of new team members as required
  • Support the team and work with colleagues to ensure department needs are met including absence coverage
  • Work in accordance with all CFPC policies, procedures and processes, and federal and provincial legislation
  • Work in accordance with all health and safety requirements
  • Demonstrate behaviours that align with the CFPC Values
  • Demonstrate competencies aligned with the CFPC Competency Framework
  • Participate on CFPC staff committees or working groups and other related projects as required

Requirements

  • PhD required
  • Minimum 5 years of related work experience in a professional environment
  • Proven written and presentation skills in a range of formats (briefings, reports, summaries, etc.) and to a range of audiences
  • Strong research and analytical skills
  • Demonstrated skills and experience with project management methodology and practices
  • Ability to work well under pressure and adapt well to changing priorities
  • Critical thinking skills and the ability to anticipate needs and outcomes
  • Demonstrated excellent organizational and follow-up skills with the ability to prioritize and to meet deadlines
  • Proven attention to detail with an eye for accuracy
  • Must be a self-starter with the ability to work both independently and in a collaborative team environment
  • Excellent work ethic matched by openness to feedback and collaboration
  • Able to exercise discretion and judgment in sensitive matters and maintain confidentiality
  • Proficient computer skills in MS Word, Outlook, Excel, PowerPoint; experience with SharePoint an asset
  • Proficient at recommending and performing statistical analysis related to assessment
  • Familiarity with online communications methods and tools
  • Knowledge of the Canadian post-secondary university system an asset
  • Experience in working with professional associations and committees that have voluntary members
  • Verbal and written communication skills, with ability to express ideas and opinions clearly and effectively in English; French language is an asset
  • Excellent communication skills with the ability to seek clarity among multiple inputs

Working Conditions

  • Open-concept office environment
  • Option of working remotely (home office)
  • Flexibility to work overtime on weekends for scheduled committee meetings
  • Occasional travel (3-4 times per year) for external meetings

Hours of Work:

  • 8:00 a.m. – 4:00 p.m. or 8:30 a.m. – 4:30 p.m. or 9:00 a.m. – 5:00 p.m. Monday to Friday.

 If you share our passion, and are committed to living our CFPC Values please submit a cover letter and your résumé referencing the posting #2019-24 to: careers@cfpc.ca by January 8, 2020

The CFPC is committed to fostering a healthy and positive work environment.  In accordance with the Accessibility for Ontarians with Disabilities Act, 2005 and the Ontario Human Rights Code, The CFPC encourages applications from all qualified candidates and will accommodate applicants’ needs throughout all stages of the recruitment and selection process.  If selected to participate in the recruitment and selection process, please inform Human Resources of any accommodation(s) that you may require to ensure your equal participation.

We thank all those who apply but only those selected for further consideration will be contacted. 

*Full-Time Equivalent

416 views