Review

Goals 

The goals of the K-12 CS framework review process are to provide transparency into the development of the K-12 CS framework and include feedback from a diverse range of voices and stakeholders. If you haven’t already, please sign up for framework updates.

All individuals and institutions are invited to be reviewers. Institutions, such as state/district departments of education and organizations (industry, companies, non-profits), are responsible for selecting an individual or a group to represent the institution.

Viewing the Framework 

The final display of the K-12 CS Framework will be as an interactive website that allows different views. See an animation of the prototype below.

k12-framework

The Framework Review Process

The review process and community engagement is an essential aspect of the framework development process. The writing teams aim to receive and respond to as much feedback as possible.

There are three public review periods of the framework.

  • Feb 3 to Feb 17: Early review of the 9-12 grade band draft.
  • March 18 to April 5: First full review of the entire K-12 concepts and practices.
  • June 8-29: Second full review of the entire K-12 concepts and practices

After each review period, the framework development staff anonymizes the data and collects all of the raw feedback into an easily viewable format and calculates the average scores from the ratings. The development staff and the advisors read through the raw feedback to identity themes that occur repeatedly; that is, suggestions that were made by multiple reviewers. The advisors also flag additional feedback that is important. These main themes and advisor recommendations are provided to the writers, along with all of the raw feedback.

The writers then read all of the feedback and make revisions to the framework. They begin by reading the raw feedback, the main themes, and the advisor recommendations, and they consider each comment. The writers document the major feedback that they received and how they considered each recommendation and incorporated it into their revisions. This documentation of feedback and response will be available in the final release of the framework, and a high-level summary is posted on the website after each review period.

Development Process Summary

The Framework began with a convening of researchers, teachers, and other stakeholders in computer science education to set the vision and the overarching structure of the framework. These experts were invited to become writers, and each interested state was also invited to nominate a writer. The writers developed and revised statements in teams based on concept area or practices, in both face to face meetings and via conference calls.

Throughout the development process, a variety of strategies were used to review and revise the framework. Writing teams completed internal peer reviews of other writing teams’ work in multiple ways, including by working across teams to revise, and working in groups by grade band expertise. Focus groups provided targeted feedback, and advisors were engaged to complete reviews under a particular lens and provide specific advice to the writers. An editor was used to work towards consistency of language.

For more information about the development process, including workshop summaries, please see the resources page.