Tuesday, June 4th |
|
|
5:30pm |
Dinner (Optional) |
Join us at Forktown Food Tours to experience some of the best food in Portland on a 1.5-hour culinary walking tour of the vibrant downtown. |
Wednesday, June 5th |
|
|
7:30am |
Check-in / Breakfast |
|
8:15am |
Welcome
Center for Assessment
|
Executive Director Dr. Scott Marion welcomes participants on behalf of the Center to Colloquium 2019. Center staff introductions. |
8:30am |
Overview
Center for Assessment
|
Dr. Brian Gong provides an overview of the Colloquium. |
8:45am |
Experts Introduction
|
Experts introduce themselves and describe one difference in education they envision and what they are working on that involves data analytics, ML, or AI. |
9:15am |
Group Discussion #1
Center for Assessment
|
Current at-scale application for data analytics, ML and AI in education.
What compelling applications in education are available now at scale (e.g., commercially, as in, a state or district might be able to adopt for operational use)?
(Working definitions)
|
10:15am |
Break |
|
10:45am |
Group Discussion #2
Center for Assessment
|
Promising paths and limitations for analytics, ML, AI applications: Applications that largely replace current assessment technologies and uses.
What are key capacities that will likely be available in 3-5 years? 5-10 years? What commonly promoted or promised applications will likely not to be operational at scale in the next 10 years? Why not? What are promising paths for adoption and implementation? What underlying work models and capacities do these applications require? How different are they from how things are currently done?
|
12:00pm |
Lunch
|
1:00pm |
Group Discussion #3
Center for Assessment
|
Promising paths and limitations for analytics, ML, AI applications: Comprehensive assessment systems.
What are key capacities that will likely be available in 3-5 years? 5-10 years? What commonly promoted or promised applications will likely not to be operational at scale in the next 10 years? Why not? What are promising paths for adoption and implementation? What underlying work models and capacities do these applications require? How different are they from how things are currently done?
|
2:30pm |
Break |
|
3:00pm |
Group Discussion #4
Center for Assessment
|
Promising paths and limitations for analytics, ML, AI applications: Intelligent systems.
What are key capacities that will likely be available in 3-5 years? 5-10 years? What commonly promoted or promised applications will likely not to be operational at scale in the next 10 years? Why not? What are promising paths for adoption and implementation? What underlying work models and capacities do these applications require? How different are they from how things are currently done?
|
4:30pm |
Adjourn for the day |
|
5:30pm |
Dinner |
Join us for dinner at Higgins. |
Thursday, June 6th |
|
|
7:30am |
Breakfast |
|
8:00am |
Synthesis
|
Synthesis and reflections from Day 1.
|
8:30am |
Group Discussion #5
Center for Assessment
|
Challenges to Quality.
What are known challenges to quality use (e.g., where do data come from; detecting biased data; dealing with variation and exceptions; privacy—similar issues could be identified for infrastructure, literacy, etc.), and how may those challenges be addressed?
|
10:00am |
Break |
|
10:30am |
Group Discussion #6
Center for Assessment
|
Evaluating Validity and Utility.
What evidence should an end-user ask for when evaluating the validity and utility of an application? How is that evidence similar to and differ from traditional evaluation of tests?
|
12:00pm |
Lunch
|
1:00pm |
Group Discussion #7
Center for Assessment
|
The Center's Role. What role can the Center play?
|
2:30pm |
Wrapup
Center for Assessment
|
Associate Director Dr. Chris Domaleski provides final reflections and thanks all participants on behalf of the Center.
|
3:00pm |
Adjourn |
|