Challenges & Shared-Tasks

  • Task 3a on Monolingual User-Centred Health Information Retrieval (IR).
    • Team composition: Vincent Claveau (IRISA-CNRS), Thierry Hamon (LIMSI & Université Paris 13), Natalia Grabar (STL CNRS-Lille3), Sébastien Le Maguer (INRIA-IRISA)
    • Results: 0.6793 NDCG@10 (best result 0.7445 NDCG@10), 14 participants
  • Task 2 of Question Answering lab at CLEF 2014 on Biomedical question answering over interlinked data (QALD-4)
    • Team composition: Thierry Hamon (LIMSI & Université Paris 13), Natalia Grabar (STL CNRS-Lille3), Fleur Mougin (ISPED, ERIAS, Université Bordeaux) et Frantz Thiessard (ISPED, ERIAS, Université Bordeaux)
    • Results: 2nd on 3
  • DEFT 2013 challenge on mining the recipes.
    • Team composition: Thierry Hamon (LIMSI & Université Paris 13), Natalia Grabar (STL CNRS-Lille3)
    • Results:
      • Task 1: associate a recipe title and text to its difficulty level (very easy, easy, moderately easy, difficult): 4th on 6
      • Task 2: associate a recipe title and text to the type of dish (starter, main dish, dessert): 3rd on 5
      • Task 3: associate a recipe text to its title: 2nd on 3
      • Task 4: extract from the title and text the list of ingredients: 5th on 5
  • Sixth i2b2/VA Shared-Task and Workshop Challenges in Natural Language Processing for Clinical Data: Event, Timex and Temporal Relations Challenge (2012), organized by I2B2 : Informatics for integrating Biology and the Bedside - a National Center for Biomedical Computing.
    • Team composition: Thierry Hamon (LIM&BIO), Natalia Grabar (STL-Lille3), Cyril Grouin (LIMSI-Orsay), Sophie Rosset (LIMSI-Orsay), Xavier Tannier (LIMSI-Orsay), Pierre Zweigenbaum (LIMSI-Orsay).
    • Results:
      • Task 1 - Events: 9th on 14 participants, Timex: 10th on 14 participants
      • Task 2 - End to End (Event/Timex and Tlink): 5th on 7 participants.
    • https://www.i2b2.org/NLP/TemporalRelations/Main.php
  • Fourth i2b2/VA Shared-Task and Workshop Challenges in Natural Language Processing for Clinical Data: Medical Concept, Assertions, Relations Extraction Challenge (2010), organized by I2B2 : Informatics for integrating Biology and the Bedside - a National Center for Biomedical Computing.
  • Third i2b2 Shared-Task and Workshop Challenges in Natural Language Processing for Clinical Data Obesity Challenge: Medication Extraction Challenge (2009), organized by I2B2 : Informatics for integrating Biology and the Bedside - a National Center for Biomedical Computing.
  • Second i2b2 Shared-Task and Workshop Challenges in Natural Language Processing for Clinical Data Obesity Challenge (A Shared-Task on Obesity): Who's obese and what co-morbidities do they (definitely/likely) have? (2008), organized by I2B2 : Informatics for integrating Biology and the Bedside - a National Center for Biomedical Computing.
    • Team composition: Natalia Grabar (SPIM INSERM, HEGP), Thierry Dart (HEGP), Thierry Hamon (LIM&BIO).
    • Results: 16th on 28 participants (macro F-measure 0,6104).
    • http://www.i2b2.org/NLP/Obesity/