Colorado Department of Early Childhood

The buyer seeks an administrator for the Colorado Shines Inter-Rater Reliability System. The administrator will ensure Environmental Rating Scale (ERS) ratings are reliable and valid. Key responsibilities include training assessors, conducting reliability observations, providing ongoing consultation, analyzing data, and maintaining expertise in ERS practices.

• 2/24/2025 - Questions Due
• 2/27/2025 - Responses to Questions Published
• 3/14/2025 - Proposal Due Date
• 7/1/2025 - Anticipated Contract Start Date

• 10 years demonstrated experience in large scale ERS Inter-Rater Reliability projects
• Authorized by Environment Rating Scales Institute to provide essential services
• Able to provide training and observation activities in Colorado annually

• Train Colorado Shines Rating Administrator ERS Assessors
• Conduct initial and re-reliability observations for ERS assessors
• Provide ongoing consultation and clarification on ERS scoring
• Collect, analyze and report reliability data
• Conduct regular meetings with assessors and QRIS manager
• Ensure inter-rater reliability on ERS scales