Loading
AIcrowd
Challenges
Organize a challenge FAQ Contact
Log In Sign Up
Round 1: Completed Round 1b: Completed Phase 2: Completed #llm #knowledge_retrieval #question_answering_systems #generative_ai #knowledge_graph #retrieval_summarization #rag
By  Meta 
154.1k
2792
384
6323
Participate
← Back to challenge

Submission #267129

graded
Submitted by

Score

0.250

Secondary Score

0.000

Message

View your submission at git@gitlab.aicrowd.com:jiazunchen/meta-comphrehensive-rag-benchmark-starter-kit@refs/tags/submission-task3-new480remmo/issues/125

Additional Information

repo_url

https://gitlab.aicrowd.com/jiazunchen/meta-comphrehensive-rag-benchmark-starter-kit

gitlab_project_id

12207

gitlab_note_id

215726

gitlab_issue_iid

125

original_submission_id

266263

exact_accuracy

0.3499706400469759

accuracy

0.4926600117439812

hallucination

0.24310041103934232

missing

0.26423957721667646

n_miss

450

n_correct

839

n_correct_exact

596

total

1703

sample_prediction_time_mean

22.810960200425253

Share