About

Each year, professional staff at the Center for Assessment identify a topic which is outside of our current areas of expertise, but is likely to have a significant impact on the field and our work in the near future. Over the course of the year, Center associates gather information on the topic, identify and interact with experts in the field, and develop a set of critical ideas/questions to be addressed. The culmination of this effort is a two-day meeting in May in which experts are convened to share information and engage in discussions with Center staff.

Colloquium 2018, Re-imagining Assessment and Accountability in an Open World, is taking place at a time when each day it is becoming increasingly clear that the education assessment industry -- which has been defined by proprietary information and software, licensing of copyrighted materials, security and tight standardization -- is in the midst of a transition to a future that looks very different. Over the last few years, we have seen significant changes in the infrastructure of traditional large-scale assessment programs; that is, the way in which those programs are designed, developed, and managed. At the same time, we are in the midst of a sea-change shifting the locus of assessment from the state to the classroom, in many ways transforming the very definition of assessment. Data from those assessments then feed diagnostic reporting and accountability systems which themselves are being impacted by a transformation in the ways in which data are being gathered, stored, processed, and information disseminated.

As we gather together in Idaho, our goals are to build our understanding of the ways in which “open” impacts what we at the Center do and how we do it, and to better position the Center to lead our clients and the industry through the transition to an open world.

Location

Colloquium 2018 will be held at the Limelight Hotel, 151 Main Street, Ketchum, Idaho. Ketchum and its close neighbor Sun Valley are located in the Wood River Valley in central Idaho. Friedman Memorial Airport lies 10 miles south of Ketchum in Hailey. The Limelight Hotel provides a shuttle service that will take participants to and from the airport.

Participants

Center Staff

Schedule

Time Topic Description
Wednesday, May 23rd
7:45 Check-in / Breakfast
8:15 Scott Marion Welcome Center for Assessment Executive Director Scott Marion welcomes participants on behalf of the Center to Colloquium 2018. Center staff introductions.
8:30 Damian Betebenner Charlie DePascale Overview Center for Assessment Damian & Charlie provide an overview of the colloquium.
8:45 What is Open? Introduction Participants introduce themselves and describe what open means in their work.
9:15 What is Open? Discussion A group discussion of what 'open' is and what open encompasses.
9:45 Break
10:15 OER: Open Educational Resources Define the current landscape of Open Educational Resources: The five Rs, market penetration, business models, legal status/fair use, equity considerations, sources, development models.
11:00 Open Assessment Why open assessment? What are the opportunities that large/small scale assessment development present to open development? What are the challenges?
12:00 Lunch
1:00 Open Assessment Open assessment consist of several pieces: Delivery platform/system/tools, items/content, analytics/algorithms (e.g., CAT algorithm), reporting, data, security/confidentiality. How do all these pieces fit within an open business model? What are some of the legal ramifications associated with the use of open licensing in assessment? What recourse is there when problems/mistakes/issues arise with open licensed content?
2:30 Break
3:00 Open Accountability, Data, and Algorithms How is open going to impact the conditions and expectations we are holding people accountable for (via accountbility systems)? How is open going to impact the conditions and expectations associated with data (e.g., privacy)? How is open going to impact the conditions and expectations associated with algorithms (e.g., machine learning) used with data?
4:30 Recess
6:00 Dinner Join us for an evening of rootop dining with spectacular views at Warfield Distillery & Brewery.
Thursday, May 24th
7:45 Synthesis Synthesis and reflections from day 1. If open development models find their way into assessment and accountability, what growing pains can we expect to see during this transition? What boundaries exist in an open world? What is the 'end game' for open resources?
9:00 Break
9:30 Next steps Next steps in the use of open in assessment and accountability? In the next 3 to 5 years what will the OER landscape look like? How can we prepare outselves and our clients for this landscape?
10:30 Wrapup Final reflections from participants/final questions from Center staff.
11:00 Adjourn

Explore

Ketchum, Sun Valley, and the surrounding area provides an abundance of things to do.

  • Wood River Valley

    The Wood River Valley offers almost endless options for outdoor recreation:

  • Sun Valley Lodge

    Sun Valley (and the Sun Valley Resort) is adjacent to Ketchum (a short 1 mile walk) and offers (summer) resort activities that are available to the general public.

  • Sun Valley History

    If you're interested in the history of the area, there are museums a short walk from our hotel.

    • The Sun Valley Museum of History is next door to the Limelight Hotel and showcases much of the skiing and mining history of the area.

    • The Ore Wagon Museum, a few blocks away in downtown Ketchum, showcases the large ore wagons used in mining days.

  • Ernest Hemmingway

    Ernest Hemmingway frequently visited the Wood River Valley and passed away in Ketchum in 1961. While staying in the Sun Valley Lodge he worked on and completed For Whom the Bell Tolls in the fall of 1939. Walking through town you'll see several tributes to him (e.g., Ernest Hemmingway STEAM School). Hemmingway is buried just down Main street in the Ketchum Cemetary. This brochure shows many of the Hemmingway related sites in the area.