The 3rd workshop on Evaluation Methods for Machine Learning
                         In conjunction with ICML 2008, Helsinki, Finland 
					Workshop Schedule
					July 9th, 2008


-------------------------------------------------------------------------------------------------------------------------------------
 9:00 -  9:25   William Klement, Nathalie Japkowicz, Chris Drummond  
                "Evaluation in Machine Learning: High Level Questions"
                
 9:25 -  9:50   Janez Desmar
                "On the Appropriateness of Statistical Tests in Machine Learning"

 9:50 - 10:15   Edith Law
                "The Problem of Accuracy as an Evaluation Criterion"

10:15 - 10:30    Discussion

-------------------------------------------------------------------------------------------------------------------------------------
10:30 - 11:00   Break
-------------------------------------------------------------------------------------------------------------------------------------

11:00 - 11:25   Niklas Lavesson, Paul Davidsson
                "Towards Application-specific Evaluation Metrics"

11:25 - 11:50   William Klement, Peter Flach
                "Soft Receiver Operating Characteristics Curves (SROC)"

11:50 - 12:15   Mohak Shah
                "Risk Bounds for Classifier Evaluation: Possibilities and Challenges"

12:15 - 12:30   Discussion

-------------------------------------------------------------------------------------------------------------------------------------
12:30 - 2:30    Lunch
-------------------------------------------------------------------------------------------------------------------------------------

 2:30 - 2:55    Rita Ribeiro, Luis Torgo
                "Utility-based Performance Measures for Regression"

 2:55 - 3:20    Marina Sokolova, Khaled El Emam
                "Evaluation of Learning from Screened Positive Examples"

 3:20 - 3:45    Joao Gama, Pedro Pereira Rodrigues, Gladys Castillo
                "Evaluating Algorithms that Learn from Data Streams"

 3:45 - 4:00    Discussion	

-------------------------------------------------------------------------------------------------------------------------------------
 4:00 - 4:30    Break
-------------------------------------------------------------------------------------------------------------------------------------

 4:30 - 4:55	Chris Drummond 
                "Finding a Balance between Anarchy and Orthodoxy"

 4:55 - 5:20    Nathalie Japkowicz
                "Classifier Evaluation: A Need for Better Education and Restructuring"

 5:20 - 6:00    Panel Discussion

-------------------------------------------------------------------------------------------------------------------------------------