Seminar: Understanding Dataset Learning Performance

Background

It is considered impossible to know the maximum possible learning performance of a machine learning (ML) algorithm on a given dataset before running the algorithm. The performance of an ML algorithm depends on many factors, such as the quality and size of the data, the complexity of the underlying patterns, the choice of algorithm, and the choice of hyperparameters. However, the “Bayes error rate” or the “Bayes optimal error” theorem estimates any algorithm’s minimum achievable error rate on a given dataset. The Bayes error rate is the lowest possible error rate that can be achieved by any classifier, assuming the optimal classifier that perfectly separates the classes is available.

Aim

Develop an algorithm that can efficiently estimate the minimum error rate level in a target
class for any given dataset with categorical variables.

Learning Objectives

• Explore interactions between rule mining strategies and neural network architectures in the context of error estimation
• Apply different concepts of error and performance metrics in machine learning
• Create an efficient algorithm to compute any dataset’s minimum error rate

Data

Literature

Up-to-date literature recommendations are provided during the lectures.

Examination

• Final project presentation, demonstrator and final report.

Contact

Dr. Luis I. Lopera G.

• Job title: Researcher
• Address:
  
  Henkestraße 91, Haus 7, 1. OG
  91052 Erlangen
  Germany
• Phone number: +49 9131 85-23605
• Email: luis.i.lopera@fau.de

Category: Courses, Courses Archive, OnlineEvent, WS2023/24