Psychometrics and Assessments
Kaiapuni Assessment of Education Outcomes (KĀ‘EO)
Dr. Englert currently serves as the lead psychometrician to support the development of a statewide Hawaiian-language assessment. Her work includes mentoring and supporting University of Hawai‘i project staff to ensure the development process meets the rigorous standards of U.S. Department of Education peer review. She also supervises a team of psychometric consultants in diverse areas, including standard setting, calibration and scaling, reliability and validity analyses, and item review.
Information
KĀʻEO Theory of Action (Hawaiian, English)
KĀʻEO Timeline
Reports
2021 KĀʻEO Technical Report
Jefferson County Public School District Early Childhood Mathematics Assessment
Dr. Englert led a team of consultants in developing early childhood mathematics assessments (kindergarten through second grade) for Jefferson County Public School District. The goal of these assessments was to provide data that the district could use to measure student academic growth. Dr. Englert also conducted student growth analyses for a districtwide early childhood reading assessment in support of Jefferson County Public School District’s federal Teacher Incentive Fund grant.
Reading Horizons Discovery Program Assessment Review
Seneca Consulting currently serves as the lead to support the development of a research base for two critical assessments of the Reading Horizons Discovery Program. The Spelling and Word Recognition and Check-ups assessments provide data that inform teachers and administrators on their students’ progress towards the overall program goal of helping all students reach reading proficiency by the end of third grade. As part of this project, Seneca Consulting is conducting a needs assessment, collaboratively developing a logic model, and performing psychometric analyses. Additionally, Seneca Consulting supervises a consultant team working on an alignment study and standard-setting.
Dr. Englert currently serves as the lead psychometrician to support the development of a statewide Hawaiian-language assessment. Her work includes mentoring and supporting University of Hawai‘i project staff to ensure the development process meets the rigorous standards of U.S. Department of Education peer review. She also supervises a team of psychometric consultants in diverse areas, including standard setting, calibration and scaling, reliability and validity analyses, and item review.
Information
KĀʻEO Theory of Action (Hawaiian, English)
KĀʻEO Timeline
Reports
2021 KĀʻEO Technical Report
Jefferson County Public School District Early Childhood Mathematics Assessment
Dr. Englert led a team of consultants in developing early childhood mathematics assessments (kindergarten through second grade) for Jefferson County Public School District. The goal of these assessments was to provide data that the district could use to measure student academic growth. Dr. Englert also conducted student growth analyses for a districtwide early childhood reading assessment in support of Jefferson County Public School District’s federal Teacher Incentive Fund grant.
Reading Horizons Discovery Program Assessment Review
Seneca Consulting currently serves as the lead to support the development of a research base for two critical assessments of the Reading Horizons Discovery Program. The Spelling and Word Recognition and Check-ups assessments provide data that inform teachers and administrators on their students’ progress towards the overall program goal of helping all students reach reading proficiency by the end of third grade. As part of this project, Seneca Consulting is conducting a needs assessment, collaboratively developing a logic model, and performing psychometric analyses. Additionally, Seneca Consulting supervises a consultant team working on an alignment study and standard-setting.
Program Evaluation
Inclusive Excellence Teacher Scholar Program
Dr. Englert is the external evaluator on a 5-year grant awarded to the University of Northern Colorado by the Howard Hughes Medical Institute. The university is using this grant to develop and administer its STEM Inclusive Excellence program, which assists faculty in recognizing their own implicit biases, beliefs, and values so that they can create more inclusive classrooms and equitble relationships with all students
Evaluation Reports
Englert, K., Reinsvold, L., Philips, E., & Allen, J. (2021). Inclusive Excellence annual evaluation report: Spring 2021. University of Northern Colorado.
Englert, K., Reinsvold, L., Philips, E., & Allen, J. (2022). Inclusive Excellence annual evaluation report: Spring 2021. University of Northern Colorado.
ADVANCE Initiative
Dr. Englert serves as the external evaluator for a National Science Foundation grant at Michigan Technological University. The goal of ADVANCE is to support faculty retention and inclusion for women and faculty of color. The evaluation has involved developing a logic model and evaluation matrix to monitor the progress toward outcomes across the multiple program activities.
Dr. Englert is the external evaluator on a 5-year grant awarded to the University of Northern Colorado by the Howard Hughes Medical Institute. The university is using this grant to develop and administer its STEM Inclusive Excellence program, which assists faculty in recognizing their own implicit biases, beliefs, and values so that they can create more inclusive classrooms and equitble relationships with all students
Evaluation Reports
Englert, K., Reinsvold, L., Philips, E., & Allen, J. (2021). Inclusive Excellence annual evaluation report: Spring 2021. University of Northern Colorado.
Englert, K., Reinsvold, L., Philips, E., & Allen, J. (2022). Inclusive Excellence annual evaluation report: Spring 2021. University of Northern Colorado.
ADVANCE Initiative
Dr. Englert serves as the external evaluator for a National Science Foundation grant at Michigan Technological University. The goal of ADVANCE is to support faculty retention and inclusion for women and faculty of color. The evaluation has involved developing a logic model and evaluation matrix to monitor the progress toward outcomes across the multiple program activities.
Instrument Development, Data Collection, and Data Analysis
Native American Student Needs Assessment
As a consultant for the Regional Educational Laboratory (REL) Central, Dr. Englert led projects for the American Indian Education Research Alliance. Two of these projects focused on supporting state Indian education directors in developing culturally relevant needs assessments that reflect the priorities of Native communities. This work included developing surveys to measure strengths and challenges in schools serving Native American students. The survey results help the state education agencies provide focused support to those schools.
As a consultant for the Regional Educational Laboratory (REL) Central, Dr. Englert led projects for the American Indian Education Research Alliance. Two of these projects focused on supporting state Indian education directors in developing culturally relevant needs assessments that reflect the priorities of Native communities. This work included developing surveys to measure strengths and challenges in schools serving Native American students. The survey results help the state education agencies provide focused support to those schools.
Educator Effectiveness
Georgia Department of Education CLASS Keys
Dr. Englert led a research study that involved collecting validity evidence on the Georgia Department of Education’s teacher evaluation system. Through teacher surveys, interviews, and document analysis, Dr. Englert and project staff (including Ms. Allen) provided a comprehensive evaluation of the system to help state policymakers understand its reliability, fairness, content, and local implementation.
Dr. Englert led a research study that involved collecting validity evidence on the Georgia Department of Education’s teacher evaluation system. Through teacher surveys, interviews, and document analysis, Dr. Englert and project staff (including Ms. Allen) provided a comprehensive evaluation of the system to help state policymakers understand its reliability, fairness, content, and local implementation.
Grant and peer review
Dr. Englert has served as a peer reviewer for the U.S. Department of Education and as a grant reviewer for the Investing in Innovation (i3) grant program. She has also co-chaired a summative assessment committee for the Colorado Department of Education tasked with recommending revisions to the statewide student assessment program.