Call for Problems for ALTA 2024 Shared Task
ALTA is seeking problems to use for the thirteenth ALTA Shared Task. The ALTA shared tasks are targeted at university students with programming experience.
The problems that we are seeking should have the following features:
- They are related to a language technology task.
- They should be easy to explain to undergraduate and Masters students with programming skills but without knowledge on language technology.
- The task should be of such a difficulty that it would encourage the participants to attempt the competition, yet it is possible to discriminate among the best submissions and pick a winner. In other words, it should be very hard to get perfect results (so that it is difficult to have ties) but simple methods should achieve encouraging results.
- It should be possible to evaluate the results automatically using an evaluation platform such as CodaLab (https://codalab.org/).
- The training and test data can be distributed to the participants freely (“free” as for “freedom”, and preferably with no or very small cost).
- The final test data should not be currently publicly available.
- And above all, the task should be fun!
The links to the previous competitions are:
- 2023: Discriminate between human-written and machine-generated text
- 2022: PIBOSO sentence classification, 10 years later
- 2021: Automatic Grading of Evidence - 10 years later
- 2020: Assess human behaviour
- 2019: Sarcasm target identification
- 2018: Classifying patent applications
- 2017: Correcting OCR errors
- 2016: Cross-KB Coreference
- 2015: Identifying French cognates in English text
- 2014: Identifying expressions of locations in tweets
- 2013: Case and punctuation restoration
- 2012: PIBOSO sentence classification
- 2011: Automatic Grading of Evidence
- 2010: Multilingual language identification
The closing date for submission of proposals is Friday 7 June 2024.
For any questions or to submit a proposal, please send an email to: shared.task@alta.asn.au.