Instructions for CLEF 2021 Working Notes in the CEUR-WS Proceedings

 

As usually, the CLEF 2021 Labs working notes will be published in the CEUR-WS.org proceedings (http://ceur-ws.org/). The electronic Working Notes will be organised according to the Labs. If one group participates in more than one Lab, separate reports are to be submitted. Moreover, for those Labs that are subdivided in several tasks, separate reports for different task(s) are to be provided.

The CLEF 2021 Working Notes will be divided into the following main sections (and sub-sections):

  • ARQMath - Answer Retrieval for Questions on Math
    • Task 1 – Answer Retrieval
    • Task 2 – Formula Search
  • BioASQ - Large-scale biomedical semantic indexing and question answering
    • Task 1 – Task A: Large-Scale Online Biomedical Semantic Indexing
    • Task 2 – Task B: Biomedical Semantic Question Answering
    • Task 3 – Task MESINESP: Medical Semantic Indexing In Spanish
    • Task 4 – Task Synergy: Question Answering for COVID-19
  • CheckThat! - Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake News
    • Task 1 – Check-worthiness estimation
    • Task 2 – Detecting previously fact-checked claims
    • Task 3 – Fake news detection
  • ChEMU - Cheminformatics Elsevier Melbourne University lab
    • Task 1 – Chemical Reaction Reference Resolution
    • Task 2 – Anaphora Resolution
  • CLEFeHealth - CLEF eHealth
    • Task 1 – Information Extraction from Noisy Text
    • Task 2 – Consumer Health Search
  • eRisk - Early Risk Prediction on the Internet
    • Task 1 – Early detection of pathological gambling
    • Task 2 – Early detection of self-harm
    • Task 3 – Depression-level estimation
  • ImageCLEF - Multimedia Retrieval Challenge in CLEF
    • Task 1 – ImageCLEFmedical
    • Task 2 – ImageCLEFcoral
    • Task 3 – ImageCLEFdrawnUI
    • Task 4 – ImageCLEFaware
  • LifeCLEF - Multimedia Life Species Identification
    • Task 1 – PlantCLEF
    • Task 2 – BirdCLEF
    • Task 3 – GeoLifeCLEF
    • Task 4 – SnakeCLEF
  • LiLAS - Living Labs for Academic Search
    • Task 1 – Ad-hoc Search Ranking
    • Task 2 – Research Data Recommendations
  • PAN - Lab on Digital Text Forensics and Stylometry
    • Task 1 – Cross-domain Authorship Verification
    • Task 2 – Multi-Author Writing Style Analysis
    • Task 3 – Profiling Haters on Twitter
  • SimpleText - (Re)Telling right scientific stories to non-specialists via text simplification
    • Pilot Task 1 – Searching for background information
    • Pilot Task 2 – Text Simplification
  • Touché - Argument Retrieval
    • Task 1 – Conversational Argument Retrieval
    • Task 2 – Comparative Argument Retrieval

 

When the author logs into easychair they will find a separate "Easychair Track" for each CLEF Lab/Workshop and once they have selected the correct "Easychair Track" for their, as in the figure below.

 

→Select the track corresponding to your Lab/Workshop

 

Afterwards, in the paper upload form, after the keywords, authors will find a checklist with the "Submission Topics" corresponding to the different tasks in that Lab. Please mark those which correspond to your paper:

 

→ Mark the topic corresponding to the lab tasks which are described in your paper.

For each task to which a group participated, groups are requested to submit a report describing their experiments. In the CEUR-WS working notes, there can be either a single paper for all the tasks to which a group participated or separated papers for each task. The decision on what is the most appropriate way to proceed for a given lab is up to the lab organizers.

After the review process, if the paper will have been accepted, authors will be requested to submit the Camera-Ready Version of the paper, according to the reviewers’ recommendations. For each camera-ready submission, three items are required:

  • Zip file containing all the submission sources
  • PDF file of the submission (with no page headers/footers/page numbers)
  • PDF file with the scanned and signed copyright agreement (otherwise, the submission will not be published in the final working notes).

 

Paper Submission

Submission of papers is to be done electronically through the EasyChair (https://easychair.org/my/conference?conf=clef2021).

Using EasyChair for Paper Submission

  1. Authors must log in using their own username and password. If you don't already have an Easychair account, you will find the instructions to obtain one on the same page.  
  2. Once you have logged in, click on "New Submission", select the correct Lab/Track and Group/Task and then follow the instructions to submit your paper.

Please, note that for preparing final Working Notes we will use the metadata of Easychair submission, so pay attention to insert authors names, title and affiliations correctly.

 

Deadlines

Please remember that the strict deadline for receiving the final electronic versions of all papers is:

  1. Working Notes Papers due 28 May 2021. This is a STRICT DEADLINE. 
  2. CEUR-WS Camera Ready Working Notes Papers due 2 July 2021. This is a STRICT DEADLINE.

All the deadlines are intended to be MIDNIGHT CEST.

 

Copyright Form

During the upload of the Camera-Ready version of the accepted papers, a scanned and signed version of the CLEF copyright form (it will be provided) must be uploaded with the source and PDF files of the submission (otherwise the submission will not be published in the final working notes).

When filling the copyright form:

  • Report the name of the contribution as indicated in the original manuscript and on the Easychair interface.
  • Report the complete list of all the authors, including the corresponding author. Names need to be equal to the ones reported in the original manuscript, and also in the same order.
  • Indicate additional information only for the corresponding author.

It is mandatory to print the copyright form, sign it by hand, and upload a scan of the signed physical copyright form.

 

 

GUIDELINES TO PREPARE REPORTS FOR CLEF2021 WORKING NOTES

The working notes papers are technical reports written in English and describing the participating systems and the conducted experiments. They should provide, at least, the following information:

  1. Title  
  2. Authors  
  3. Affiliations  
  4. Email addresses of all authors  
  5. Body of text. This should contain information on:  
    • tasks performed  
    • main objectives of experiments  
    • approach(es) used and progress beyond state-of-the-art  
    • resources employed  
    • results obtained  
    • analysis of the results  
    • perspectives for future work  

The papers must be formatted according to CEUR-WS template available at https://drive.google.com/drive/folders/1K5encrAZu08WYdS5lREZ94gOOEvAUJqS?usp=sharing), either using Word or Latex one column templates.

MAX LENGTH: no upper page limit is set, as papers are published only electronically, but experience teaches the overwhelmingly long papers are not effective.  

If you need to refer to the LNCS proceedings or to the Working Notes as a whole, here is the information about them:

 

LNCS

Experimental IR Meets Multilinguality, Multimodality, and Interaction.

Proceedings of the Tenth International Conference of the CLEF Association (CLEF 2021)

 

Editors

K. Selcuk Candan, Bogdan Ionescu, Lorraine Goeuriot, Birger Larsen, Henning Müller, Alexis Joly, Maria Maistro, Florina Piroi, Guglielmo Faggioli, Nicola Ferro

 

 

CEUR-WS

CLEF 2021 Working Notes

Working Notes of CLEF 2021 - Conference and Labs of the Evaluation Forum

 

Editors

Guglielmo Faggioli, Nicola Ferro, Alexis Joly, Maria Maistro, Florina Piroi