DSAI Challenge UPDATE: decommissioning workspaces, final presentations, leaderboard

Hi,

Now that the submission deadline is over, when will the private leaderboard be released? We are looking forward the final leaderboard!

Thanks!
Carlos

View post 1

UPDATE / EXTENSION: DSAI Challenge: Leaderboard & Presentation deadlines

Hi,

It’s been a few days and the leaderboard is still showing the old scores. Do you have any idea when will the leaderboard be updated with the new data?

Thanks!
Carlos

View post 1

UPDATE / EXTENSION: DSAI Challenge: Leaderboard & Presentation deadlines

Hi,

When Will you update the public leaderboard? Will all the submissions be updated? That would be super helpful.

Thanks!
Carlos

View post 0

Final submission selection

As some colleague already said if you take all the submissions you are just encouraging to submit like crazy and try your luck. But this is just my point of view.

Best,
Carlos

View post 1

Is the scoring function F1 or logloss?

From my point of view it would be painful to take the one with the best partial score as we have one with almost the same partial score that we think could generalize better.

View post 0

Final submission selection

Hi,

How will our final submission be selected? Will all the submissions we do run for the final leaderboard?

Thanks,
Carlos

View post 0

Test file changed

image.jpg1916×910 892 KB

As you can see in the picture the new test file has some new columns that are breaking the format completely. I compared with the testing_phase2_release_small file and you can see that the extra columns are not there.

View post 0

Test file changed

image.png726×114 15.5 KB

I had some code that it was previously working and in the evaluation cluster is still working but if I try to run it with that “new” test file in my workspace is not working.

The submission I am talking about is AIcrowd Submission Received #28775. ( https://gitlab.aicrowd.com/carlos.cortes/dsai-challenge-solution/issues/88 )

Thanks a lot for your answer!
Carlos

View post 0

Test file changed

Hi,

I was trying to re-run an old submission that worked and it is now failing. When I check the test file in /shared_data/data/test_data_full the modified date is today at 8:59.

Can someone please explain why was it modified? I don’t think the test file should be modified during the competition.

Thanks!
Carlos

View post 0

How is F1 score calculated?

Hi,

I was wondering how is the F1 score in the leaderboard calculated from the probabilites, is it taking a 0.5 threshold?

Thanks!
Carlos

View post 0

Is the scoring function F1 or logloss?

Hi,

Can you confirm all the submission be considered for the final leaderboard? Or do we send to send something like a final submission?

Thanks!
Carlos

View post 0

How to access error logs?

Hi,

Maybe they show some better way but what I was doing is run with the test file that you can find in the shared folder.

Best,
Carlos

View post 0

Team name in leaderboard

Great, thanks a lot!

View post 0

Team name in leaderboard

Hi,

I was able to do our first submission to the leaderboard following all the resources you shared but now the submission is under my username and not under my team name.
How can I change the name in the learderboard? Should I create a gitlab user with the team name?

Thanks!
Carlos

View post 0