Logo of Huzzle

Psychometrician

  • Job
    Full-time
    Mid & Senior Level
  • Research & Development
  • $100K - $140K
  • Quick Apply

AI generated summary

  • You need a Ph.D. or Ed.D. in Psychometrics or related field, 3+ years of psychometrics experience, proficiency in IRT and CTT, strong statistical software skills, excellent communication, and a passion for education.
  • You will analyze assessment data, conduct psychometric evaluations, and provide actionable insights, ensuring validity and fairness of assessments. Conduct research, prepare technical reports, and provide training and support.

Requirements

  • A doctoral degree (Ph.D. or Ed.D.) in Psychometrics, Educational Measurement, Quantitative Psychology, or a related field.
  • At least 3 years of experience in psychometrics, educational measurement, or a related field, preferably within an educational assessment company or academic setting.
  • Experience with item response theory (IRT), classical test theory (CTT), and other psychometric models.
  • Proficiency in statistical software and programming languages (e.g., Python, R, Stata).
  • Strong analytical, problem-solving, critical thinking, time management and organizational skills.
  • Excellent written and verbal communication skills.
  • Ability to work collaboratively in a team-oriented environment.
  • Ability to translate complex technical and psychometrics research and statistical information into team-facing and user-facing results, actionable plans, and recommendations.
  • A passion for education and a drive to improve assessment materials and experiences for educators and learners

Responsibilities

  • Data Analysis and Validation:
  • Conduct statistical analyses to evaluate the reliability, validity, and fairness of assessments (maintain item pValues, field testing items, etc.)
  • Perform item analysis, differential item functioning (DIF) analysis, and other psychometric evaluations.
  • Evaluate criterion, proficiency predictive validity evidence and provide actionable insights for internal stakeholders to ensure student performance on assessments predicts performance and proficiency levels on high-stakes assessments.
  • Evaluate consequential validity evidence to provide insights to internal and external stakeholders.
  • Evaluate p validity evidence and provide actionable insights for internal stakeholders to ensure student performance on assessments predicts performance on high-stakes assessments.
  • Analyze test data to generate reports and provide actionable insights for internal and external stakeholders.
  • Research and Methodology:
  • Conduct validity studies in partnership with the Research team for specific districts/institutions and markets.
  • Stay current on advancements in psychometric methods and educational measurement as well as state assessment requirements, suggesting new and revised assessment methodologies.
  • Partner with Research and Products to contribute to scholarly publications and/or conference proposals.
  • Partner with product managers and team to inform assessment strategy
  • Technical Documentation:
  • Prepare technical reports and documentation detailing psychometric analyses, methodologies, and findings.
  • Ensure clear communication of complex statistical concepts to non-technical audiences.
  • Quality Assurance:
  • Participate in quality assurance processes to ensure the accuracy and integrity of assessment data and results.
  • Collaborate with software developers to implement and refine automated scoring and analysis systems.
  • Training and Support:
  • Provide training and support to internal teams and external partners on psychometric principles and best practices.
  • Assist in the development of training materials and resources.

FAQs

What qualifications are required to be a Psychometrician at Instructure?

To be a Psychometrician at Instructure, you will need a doctoral degree (Ph.D. or Ed.D.) in Psychometrics, Educational Measurement, Quantitative Psychology, or a related field. Additionally, at least 3 years of experience in psychometrics, educational measurement, or a related field is preferred.

What will I be responsible for as a Psychometrician at Instructure?

As a Psychometrician at Instructure, you will be responsible for data analysis and validation, research and methodology, technical documentation, quality assurance, and training and support. This includes conducting statistical analyses, evaluating the reliability and validity of assessments, staying current on advancements in psychometric methods, preparing technical reports, and providing training to internal teams and external partners.

What skills are necessary to succeed as a Psychometrician at Instructure?

Strong analytical, problem-solving, critical thinking, time management, and organizational skills are essential for success as a Psychometrician at Instructure. Proficiency in statistical software and programming languages, excellent written and verbal communication skills, and the ability to work collaboratively in a team-oriented environment are also important.

Education
Industry
1001-5000
Employees
2008
Founded Year

Mission & Purpose

Instructure is a technology company that develops innovative software solutions for educational institutions and businesses. Their primary product, Canvas, is a widely used learning management system (LMS) that facilitates online teaching, learning, and administrative functions. Instructure's ultimate mission is to enhance education through modern technology, making learning more accessible and effective for students and educators alike. Their purpose is to empower teachers, administrators, and learners by providing tools that streamline educational processes and improve learning outcomes.

Culture & Values

  • Openness

    We’re open to new people, new ideas, and new opportunities. We strive to be collaborative in our projects, transparent about our intentions, and curious about how things work and how to make them better. Open minds open doors.

  • Relationships

    We're all about building meaningful relationships based on trust, respect, and mutual success, whether they're peer-peer, teacher-student, manager-employee, or company-customer. People come first.

  • Equality

    We aspire to offer an inclusive and welcoming culture, and we believe people deserve equal access to opportunities and resources. You can't have equality without equity.

  • Ownership

    We're all accountable for excellence in our work and our actions, and we stand behind our products and services. Say. Do. Repeat.

  • Simplicity

    Our software makes lifelong learning easier. We strive for clarity and ease of use across the board, from product design to communication to customer experience. Simpler is smarter.