目前鎖定幾個跟 NLP 和 RL 有關的比賽如下，之後都會嘗試再看要針對哪些衝看看：

• NLP

  • Kaggle - LLM Science Exam
    Inspired by the OpenBookQA dataset, this competition challenges participants to answer difficult science-based questions written by a Large Language Model. Your work will help researchers better understand the ability of LLMs to test themselves, and the potential of LLMs that can be run in resource-constrained environments.
    Timeline:
  1. July 11, 2023 - Start Date.
  2. October 3, 2023 - Entry Deadline. You must accept the competition rules before this date in order to compete.
  3. October 3, 2023 - Team Merger Deadline. This is the last day participants may join or merge teams.
  4. October 10, 2023 - Final Submission Deadline.
  • CommonLit - Evaluate Student Summaries

  The goal of this competition is to assess the quality of summaries written by students in grades 3-12. You'll build a model that evaluates how well a student represents the main idea and details of a source text, as well as the clarity, precision, and fluency of the language used in the summary. You'll have access to a collection of real student summaries to train your model. Your work will assist teachers in evaluating the quality of student work and also help learning platforms provide immediate feedback to students.

  Timeline:

  1. July 12, 2023 - Start Date.
  2. October 4, 2023 - Entry Deadline. You must accept the competition rules before this date in order to compete.
  3. October 4, 2023 - Team Merger Deadline. This is the last day participants may join or merge teams.
  4. October 11, 2023 - Final Submission Deadline.
  • The Trojan Detection Challenge 2023 (LLM Edition)

  The competition features two main tracks: the Trojan Detection Track and the Red Teaming Track. In the Trojan Detection Track, participants are given large language models containing hundreds of trojans and tasked with discovering the triggers for these trojans. In the Red Teaming Track, participants are challenged to develop automated red teaming methods that elicit specific undesirable behaviors from a large language model fine-tuned to avoid those behaviors.
  Timeline:

  1. July 17: Registration opens on CodaLab
  2. July 25: The development phase begins
  3. October 24: Final submissions for the development phase
  4. October 24: The test phase begins
  5. October 28: Final submissions for the test phase
  6. November 1: Winners are announced

• RL

  • Melting Pot Contest 2023
    In collaboration with colleagues from Google DeepMind and MIT, the Cooperative AI Foundation is running the first cooperative AI contest as part of NeurIPS 2023. We challenge you to push the boundaries of multi-agent reinforcement learning by developing agents that can solve diverse mixed-motive cooperation problems from the Melting Pot environment suite.
    Timeline:
  1. August 25: Development phase begins
  2. September 8: Compute funding provided
  3. October 31: Development phase ends and evaluation phase begins
  4. November 15: Evaluation phase ends
  5. December 10-16: NeurIPS

• CV

  • NeurIPS 2023 Machine Unlearning Challenge
    Check phase: Begins June 28, 2023. Initial announcement and availability of the “starting kit”, containing a notebook with an example simple unlearning algorithm and a simple metric for evaluation, so that participants can start practicing.
    **Timeline: **
  1. Feedback phase: September 11, 2023 - November 27, 2023. Submission site opens and participants can start making submissions on Kaggle.
  2. Final phase: Starting November 27, 2023. During this phase, the organizers can run additional analyses on the submitted unlearning algorithms, including different metrics and datasets.