The AutoML Cup is a competition that will challenge participants to design AutoML methods that perform well on a diverse set of tasks and data settings. It is a direct follow-up to the AutoML Decathlon 2022, comprising diverse, real-world problems whose domains are far afield from standard machine learning testbeds such as vision and language.
While the 2022 edition of the AutoML Decathlon competition explored the intersection of AutoML and data-centric AI along the axis of task diversity, this year’s AutoML Cup goes a step further by challenging competitors to cope with additional real-world data issues. With the key goal of maximizing scientific progress, the competition will feature several phases, similar to the impactful first AutoML challenge by ChaLearn. We will mandate participants to open-source their solutions after each phase in order to claim prizes, enabling participants to bootstrap from each others’ solutions. The phases will vary in data dimensions and resource settings (e.g., limited access to labeled training data).
Prizes
Winning teams will be awarded exciting hardware!!!
To be eligible for prizes, you must make a submission for each of the three competition phases and make your submission open source at the conclusion of each phase. After the competition, the top ranked teams will also be featured in a retrospective paper that dives into the results and key takeaways of the competition.
To avoid conflicts of interest, all competition organizers are ineligible for prizes.
Important Dates
The AutoML Cup will include three phases.
Phase 1: June 6st — July 10th, 2023
- The first phase will emphasize diverse 1D tasks.
- Make your phase 1 submission here!
Phase 2: July 1st — August 5th, 2023
- The second phase will expand beyond 1D tasks to include tasks with different input dimensionalities.
Phase 3: August 1st — September 5th, 2023
- The third and final phase will build on the first two phases but will additionally require handling situations in which access to labeled data is limited.
FAQ
Please check back soon for updates.
Organizers
- Sonia Cromp - University of Wisconsin-Madison
- Samuel Guo - Carnegie Mellon University
- Jeffrey Li - University of Washington
- Adrien Pavao - University of Paris-Saclay
- Nicholas Roberts - University of Wisconsin-Madison
- Spencer Schoenberg - University of Wisconsin-Madison
- Cong Xu - Hewlett Packard Enterprise
- Ameet Talwalkar - Carnegie Mellon University
- Frederic Sala - University of Wisconsin-Madison
Sponsors
Please check back soon for updates.