Schedule "First Workshop on ROC Analysis in AI" Valencia, Spain, 22 August, 2004 Room: 013 09:00-09:15 # Welcome 09:15-10:15 # Invited Talk: Peter Flach "Recent advances in Machine Learning applications of ROC analysis" 10:15-10:45 # Coffee Break (ECAI coffee break 10:30-11:00) 10:45-12:00 # SESSION 1 What ROC Curves Can't Do (and Cost Curves Can) Chris Drummond, Robert C. Holte Confidence Bands for ROC Curves: Methods and an Empirical Study Sofus A. Macskassy, Foster Provost An Empirical Analysis of the Relationship Between AUC and Eight Standard Supervised Learning Performance Criteria Rich Caruana, Alexandru Niculescu-Mizil 12:00-12:15 # break 12:15-13:30 # SESSION 2 Interestingness measures based on supervised learning. Application to terminology extraction Mathieu Roche, Jerome Aze, Yves Kodratoff, Michele Sebag ROC Optimisation of Legacy Critical Systems Jonathan E. Fieldsend and Richard M. Everson Optimizing Area Under Roc Curve with SVMs Alain Rakotomamonjy 13:30-15:00 # Lunch 15:00-16:15 # SESSION 3 Cautious Classifiers C. Ferri, J. Hernandez-orallo Precision and Recall Optimisation for Information Access Tasks Michelle J. Fisher and Jonathan E. Fieldsend and Richard M. Everson Learning Mixtures of Localized Rules by Maximizing the Area Under the ROC Curve Tobias Sing and Niko Beerenwinkel and Thomas Lengauer 16:15-16:35 # SESSION 4a Presentation of 1st European Workshop on the Assessment of Diagnostic Performance 16:35-17:25 # SESSION 4b ROC Analysis of Example Weighting in Subgroup Discovery Branko Kavsek, Nada Lavrac and Ljupco Todorovski An Empirical Evaluation of Supervised Learning for ROC Area Rich Caruana, Alexandru Niculescu-Mizil 17:25-17:40 # Conclusions and discussion 17:40-18:00 # Coffee Break (ECAI coffee break 17:30-18:00)