Location
Badges
Activity
Ratings Progression
Challenge Categories
Challenges Entered
Trick Large Language Models
Latest submissions
Machine Learning for detection of early onset of Alzheimers
Latest submissions
Measure sample efficiency and generalization in reinforcement learning using procedurally generated environments
Latest submissions
Self-driving RL on DeepRacer cars - From simulation to real world
Latest submissions
Multi-Agent Reinforcement Learning on Trains
Latest submissions
Multi Agent Reinforcement Learning on Trains.
Latest submissions
See Allgraded | 32812 | ||
graded | 32811 | ||
graded | 32810 |
Multi-Agent Reinforcement Learning on Trains
Latest submissions
Participant | Rating |
---|---|
student | 271 |
leonid_didukh | 0 |
Participant | Rating |
---|
CYD Campus Aircraft Localization Competition
Private leaderboard
Almost 4 years agoHello,
Can you please clarify which submission will be selected for calculating the private score?
Thank you.
Duplicate submission
Almost 4 years ago@shivam Thank you.
I think I understand why it happened. I selected file, which forced form submission, but also clicked a button and it caused second form submission.
Possible solution is to block button once the file is selected, but for sure you should know better how to fix it
Duplicate submission
Almost 4 years agoEven worse it repeated again.
So now we lost 2 submissions per day.
Duplicate submission
Almost 4 years agoHello,
Seems that one of my submissions was sent twice - donβt know how it happened.
Difference is 4 seconds and same score.
Most funny thing that our team has -1 submission now :))
Will be great if you can remove this junk submission.
Thank you.
End of Round 1
Over 4 years agoDear Martin (@masorx ),
Sorry for messaging here, but I not sure if my mails reached you.
Can you please confirm that you received source codes.
Thank you.
Best regards,
Vitaly Bondar
End of Round 1
Over 4 years ago@masorx, can you please inform how shall we provide source codes for verification?
End of Round 1
Over 4 years agoHello.
That is a really nice competition with the new field for our ck.ua team. Always interesting to see tasks which have direct application and build a solution that can help somebody.
I would like to thanks organizers, congratulate winners, and congratulate all competitors with an interesting experience.
We totally agree that the main mistakes in organizing this competition were 100 submissions per day and opened final leaderboard. You can easily reduce submissions to 5-10 per day, but you should exclude failed submission. And if this is possible you can show results for part of test aircrafts. And only after finishing show final results of the rest of the test aircrafts. Just check how public/private leaderboards work in Kaggle - that is a really nice solution.
And about submissions count. In the last hour of the competition I already saw one of the slides in our future presentation about competition. And the title of that slide "How we lost βoverfitting challengeβ
By the way, my separate congratulations to ZAviators (@benoit_figuet and @rmonstein ) with the impressive finish. I am looking forward to hearing from you a cool story about that last day of the competition.
Affiliation of richardalligier
Over 4 years agoCommon people.
What are you talking about?
Yes, Richard has experience in the field and this gives him some advantage. But this is FAIR advantage. He has no access to test data, no information about how data was collected, etc. He breaks no rules.
With the same points, you can claim people who work as ML engineers as they know how to use machine learning techniques already, but somebody needs to learn it during the competition.
For sure I also want to win, but if somebody with more experience will win thatβs ok. I will just check his solution and study from it. Please keep your heads cold.
My point is there is no rules violation.
Good luck to all competitors.
Data from the future
Over 4 years ago-
I agree that models need to be practical and useful
-
It depends what is practical. For example if your task is anti-spoofing then this is right idea to see all airplane track
-
That is incorrect to add significant details to rules in the final stage of the competition.
-
Train data that we have includes βdata from futureβ and obviously all use it.
-
It will be practical if model should be limited by the data that was given by organizers in data archive.
Flatland Challenge
Duplicate submission from our team
Almost 5 years agoHello.
I not understand how it happened. But when i was pushing single submission today 11:34 UTC. The system also has taken 1 more submission (51) that was already sent by my teammate at 00:42.
It just so happened that I saw this only after sending one more submission (that is 5th in 24 hours).
Can you please remove submission https://gitlab.aicrowd.com/vitaly_bondar/flatland/issues/51
You can easily verify that it is the same source codes as in https://gitlab.aicrowd.com/vitaly_bondar/flatland/issues/50
Thanks.
Submissions counting
Almost 5 years agoHello.
Can you please clarify how daily submission limit counts.
What time zone used for start of the day?
Do you include failed submissions in this count?
Thank you.
Evaluation time
Almost 5 years agoHere is an example:
https://gitlab.aicrowd.com/vitaly_bondar/flatland/issues/4
It shows: βTotal Execution Time : 52061sβ, what is more than 14 hours.
And anyway it is scored.
I hope that you will review all submissions, not only submissions of our team to keep fairness in the competition
Evaluation time
Almost 5 years agoDear @shivam,
My question is about overall submission time limit.
I am interested how you measure time for it.
I see that submissions that evaluated more than 8 hours are still scored.
So i wonder do you mesure only our code time.
cc @mlerik
Further questions regarding submissions
Almost 5 years agoHello Eric,
Yes, that is perfectly explains calculations.
Thank you.
Further questions regarding submissions
Almost 5 years agoHi @mlerik
The score is mean percentage of agents who solved their own objective
Does it mean that you calculatearrived_trains / len(trains)
and then calculate mean over all episodes?
Or you calculate global amount of arrived trains and divide on global count of trains.
Thanks.
Evaluation time
Almost 5 years agoHello,
Can you please explain how time limit works.
Do you count the whole time of evaluation? Or you remove time used for environment calculations?
What is time limit? 8 hours?
Thank you.
Is teams allowed?
Over 5 years agoHello,
Is it possible to compete in this challenge as a team?
And how to make this?
Thanks
Round 2 - Preliminary Wrap-Up
Almost 4 years agoHello Martin,
Thank you for posting an update.
Can you please say why our team has a public score that differs from the leaderboard. We had 90.131 and there is 105.827 in the table. Did you face reproduction problems?
Upd: It seems that you used the wrong submission in the table.