Commit 078498f7 authored by Anthony Larcher's avatar Anthony Larcher
Browse files

add evaluation plan

parent 3b09acc7
......@@ -17,9 +17,22 @@ Contact email: <lifelong-speaker-evaluation@univ-lemans.fr>
## Challenge description
### Evaluation plan
The ALLIES project aims at catalysing the development of autonomous
lifelong intelligent systems by providing the community with scenarios,
evaluation plans and metrics to evaluate those systems.
ALLIES focuses on two tasks: speaker segmentation, and machine
translation. The speaker segmentation evaluation relies on a
new corpus of audio-visual documents (news, debates, talk show…)
from the French channel LCP.
The evaluation is coordinated by the LNE (Laboratoire national
de métrologie et d'essais, France), LIUM (Le Mans Université, France),
IDIAP (Switzerland) and UPC (Spain).
This evaluation plan defines the tasks to be benchmarked and includes
all necessary information to participants.
### Evaluation plan
See **ALLIES_evaluation_plan_V0.pdf** in this repository.
### The tasks
......
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment