Loading
2 Follower
0 Following
vitaly_bondar

Location

UA

Badges

4
2
2

Activity

Dec
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
Mon
Wed
Fri

Ratings Progression

Loading...

Challenge Categories

Loading...

Challenges Entered

Latest submissions

No submissions made in this challenge.

Machine Learning for detection of early onset of Alzheimers

Latest submissions

No submissions made in this challenge.

Measure sample efficiency and generalization in reinforcement learning using procedurally generated environments

Latest submissions

No submissions made in this challenge.

Self-driving RL on DeepRacer cars - From simulation to real world

Latest submissions

No submissions made in this challenge.

Multi-Agent Reinforcement Learning on Trains

Latest submissions

No submissions made in this challenge.

Latest submissions

See All
graded 120010
graded 119650
graded 118637

Multi Agent Reinforcement Learning on Trains.

Latest submissions

See All
graded 32812
graded 32811
graded 32810

Multi-Agent Reinforcement Learning on Trains

Latest submissions

No submissions made in this challenge.
Participant Rating
student 271
leonid_didukh 0
Participant Rating
  • CkUa Flatland Challenge
    View
  • ck.ua CYD Campus Aircraft Localization Competition
    View

CYD Campus Aircraft Localization Competition

Round 2 - Preliminary Wrap-Up

Almost 4 years ago

Hello Martin,

Thank you for posting an update.

Can you please say why our team has a public score that differs from the leaderboard. We had 90.131 and there is 105.827 in the table. Did you face reproduction problems?

Upd: It seems that you used the wrong submission in the table.

Private leaderboard

Almost 4 years ago

Hello,

Can you please clarify which submission will be selected for calculating the private score?

Thank you.

Duplicate submission

Almost 4 years ago

@shivam Thank you.
I think I understand why it happened. I selected file, which forced form submission, but also clicked a button and it caused second form submission.

Possible solution is to block button once the file is selected, but for sure you should know better how to fix it :slight_smile:

Duplicate submission

Almost 4 years ago

Even worse it repeated again.
So now we lost 2 submissions per day.

Duplicate submission

Almost 4 years ago

Can somebody return us 1 submission? :slight_smile:
@masorx

Duplicate submission

Almost 4 years ago

Hello,

Seems that one of my submissions was sent twice - don’t know how it happened.
Difference is 4 seconds and same score.

Most funny thing that our team has -1 submission now :))

Will be great if you can remove this junk submission.

Thank you.

End of Round 1

Over 4 years ago

Dear Martin (@masorx ),

Sorry for messaging here, but I not sure if my mails reached you.
Can you please confirm that you received source codes.

Thank you.

Best regards,
Vitaly Bondar

End of Round 1

Over 4 years ago

@masorx, can you please inform how shall we provide source codes for verification?

End of Round 1

Over 4 years ago

Hello.

That is a really nice competition with the new field for our ck.ua team. Always interesting to see tasks which have direct application and build a solution that can help somebody.
I would like to thanks organizers, congratulate winners, and congratulate all competitors with an interesting experience.

We totally agree that the main mistakes in organizing this competition were 100 submissions per day and opened final leaderboard. You can easily reduce submissions to 5-10 per day, but you should exclude failed submission. And if this is possible you can show results for part of test aircrafts. And only after finishing show final results of the rest of the test aircrafts. Just check how public/private leaderboards work in Kaggle - that is a really nice solution.

And about submissions count. In the last hour of the competition I already saw one of the slides in our future presentation about competition. And the title of that slide "How we lost β€œoverfitting challenge” :slight_smile:
By the way, my separate congratulations to ZAviators (@benoit_figuet and @rmonstein ) with the impressive finish. I am looking forward to hearing from you a cool story about that last day of the competition.

Affiliation of richardalligier

Over 4 years ago

Common people.
What are you talking about?

Yes, Richard has experience in the field and this gives him some advantage. But this is FAIR advantage. He has no access to test data, no information about how data was collected, etc. He breaks no rules.

With the same points, you can claim people who work as ML engineers as they know how to use machine learning techniques already, but somebody needs to learn it during the competition.

For sure I also want to win, but if somebody with more experience will win that’s ok. I will just check his solution and study from it. Please keep your heads cold.

My point is there is no rules violation.

Good luck to all competitors.

Data from the future

Over 4 years ago

  1. I agree that models need to be practical and useful

  2. It depends what is practical. For example if your task is anti-spoofing then this is right idea to see all airplane track

  3. That is incorrect to add significant details to rules in the final stage of the competition.

  4. Train data that we have includes β€œdata from future” and obviously all use it.

  5. It will be practical if model should be limited by the data that was given by organizers in data archive.

Flatland Challenge

Duplicate submission from our team

Almost 5 years ago

Hello.

I not understand how it happened. But when i was pushing single submission today 11:34 UTC. The system also has taken 1 more submission (51) that was already sent by my teammate at 00:42.
It just so happened that I saw this only after sending one more submission (that is 5th in 24 hours).

Can you please remove submission https://gitlab.aicrowd.com/vitaly_bondar/flatland/issues/51
You can easily verify that it is the same source codes as in https://gitlab.aicrowd.com/vitaly_bondar/flatland/issues/50

Thanks.

Submissions counting

Almost 5 years ago

Hello.

Can you please clarify how daily submission limit counts.

What time zone used for start of the day?
Do you include failed submissions in this count?

Thank you.

Evaluation time

Almost 5 years ago

Here is an example:
https://gitlab.aicrowd.com/vitaly_bondar/flatland/issues/4

It shows: β€œTotal Execution Time :hourglass: : 52061s”, what is more than 14 hours.
And anyway it is scored.

I hope that you will review all submissions, not only submissions of our team to keep fairness in the competition :slight_smile:

Evaluation time

Almost 5 years ago

Dear @shivam,

My question is about overall submission time limit.
I am interested how you measure time for it.

I see that submissions that evaluated more than 8 hours are still scored.
So i wonder do you mesure only our code time.

cc @mlerik :wink:

Further questions regarding submissions

Almost 5 years ago

Hello Eric,

Yes, that is perfectly explains calculations.

Thank you.

Further questions regarding submissions

Almost 5 years ago

Hi @mlerik

The score is mean percentage of agents who solved their own objective
Does it mean that you calculate arrived_trains / len(trains) and then calculate mean over all episodes?
Or you calculate global amount of arrived trains and divide on global count of trains.

Thanks.

Evaluation time

Almost 5 years ago

Hello,

Can you please explain how time limit works.
Do you count the whole time of evaluation? Or you remove time used for environment calculations?

What is time limit? 8 hours?

Thank you.

Is teams allowed?

Over 5 years ago

Hello,

Is it possible to compete in this challenge as a team?
And how to make this?

Thanks

vitaly_bondar has not provided any information yet.