Workshop Schedule

Time	Presentation
	Session 1
9:00 - 9:05	Opening Chris Drummond, Nathalie Japkowicz, William Klement, Sofus Macskassy
9:05 - 9:50	Invited Talk 1 Open Science in Machine Learning (abstract) Cheng Soon Ong
9:50 - 10:05	Paper Presentation Replicability in not Reproducibility: Nor is it Good Science (pdf) Chris Drummond
10:05 - 10:20	Paper Presentation Generalized Domains for Empirical Evaluations in Reinforcement Learning (pdf) Shimon Whiteson, Brian Tanner, Matthew E. Taylor, Peter Stone
10:20 - 10:30	Discussion
10:30 - 11:00	Coffee Break
	Session 2
11:00 - 11:45	Invited Talk 2 (to be announced..!) (abstract) Carla Brodley
11:45 - 12:00	Paper Presentation Record Linkage Measures in an Entity Centric World (pdf) Matthew Michelson, Sofus Macskassy
12:00 - 12:15	Paper Presentation Evaluating Evaluation Measures (pdf) Amit Dhurandhar, Alin Dobra
12:15 - 12:30	Discussion
12:30 - 14:00	Lunch Break
	Session 3
14:00 - 14:45	Invited Talk 3 (to be announced..!) (abstract) Nitesh Chawla
14:45 - 15:00	Paper Presentation Generic vs. Domain-oriented Evaluation Methods for Fielded Applications (pdf) Chunsheng Yang, Yubin Yang
15:00 - 15:15	Paper Presentation Class Probabilities and the ROC Curve in Changing Environments (pdf) William Klement, Nathalie Japkowicz, Stan Matwin
15:15 - 15:30	Discussion
15:30 - 16:00	Coffee Break
	Session 4
16:00 - 16:15	Paper Presentation An Evaluation of the Value Added by Informative Metrics (pdf) Colin Bellinger, Jeffrey Lalonde, Michael W. Floyd, Vikram Mallur, Elkanzi Elkanzi, Diman Ghazi, Jennifer He, Alain Mouttham, Martin Scaiano, Elaine Wehbe, Nathalie Japkowicz
16:15 - 16:30	Paper Presentation Judging the Performance of Cascading Models: A First Look (pdf) Matthew Michelson, Sofus Macskassy
16:30 - 16:45	Paper Presentation Hold-out Risk Bounds for Classifier Performance Evaluation (pdf) Mohak Shah, Sara Shanian
16:45 - 17:45	Discussion & Closing