Loading
2 Follower
4 Following
MasterScrat
Florian Laurent

Organization

NyxAI

Location

CH

Badges

4
2
2

Connect

Activity

Dec
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
Mon
Wed
Fri

Ratings Progression

Loading...

Challenge Categories

Loading...

Challenges Entered

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

A benchmark for image-based food recognition

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Measure sample efficiency and generalization in reinforcement learning using procedurally generated environments

Latest submissions

See All
graded 67944
graded 67942

Multi-Agent Reinforcement Learning on Trains

Latest submissions

See All
failed 99379
graded 99368
graded 99359

A benchmark for image-based food recognition

Latest submissions

No submissions made in this challenge.

Sample-efficient reinforcement learning in Minecraft

Latest submissions

See All
graded 85625

Multi-agent RL in game environment. Train your Derklings, creatures with a neural network brain, to fight for you!

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Sample-efficient reinforcement learning in Minecraft

Latest submissions

See All
graded 25410
graded 25409
failed 25399

Multi Agent Reinforcement Learning on Trains.

Latest submissions

See All
failed 67801
failed 67786
failed 67761

Latest submissions

No submissions made in this challenge.

5 Problems 15 Days. Can you solve it all?

Latest submissions

No submissions made in this challenge.

Project 2: Road extraction from satellite images

Latest submissions

No submissions made in this challenge.

Project 2: build our own text classifier system, and test its performance.

Latest submissions

No submissions made in this challenge.

A new benchmark for Artificial Intelligence (AI) research in Reinforcement Learning

Latest submissions

No submissions made in this challenge.

Predict if users will skip or listen to the music they're streamed

Latest submissions

No submissions made in this challenge.

Multi-Agent Reinforcement Learning on Trains

Latest submissions

See All
graded 114689
Participant Rating
shivam 136
anssi 221
Participant Rating
junjie_li 308
anssi 221
manueth 0
thomas_simonini 0

πŸš‚ Flatland Workshop

About the πŸš‚ Flatland Workshop category

Over 3 years ago

(Replace this first paragraph with a brief description of your new category. This guidance will appear in the category selection area, so try to keep it below 200 characters.)

Use the following paragraphs for a longer description, or to establish category guidelines or rules:

  • Why should people use this category? What is it for?

  • How exactly is this different than the other categories we already have?

  • What should topics in this category generally contain?

  • Do we need this category? Can we merge with another category, or subcategory?

Flatland Workshop-b33f21

About the Flatland Workshop-b33f21 category

Over 3 years ago

(Replace this first paragraph with a brief description of your new category. This guidance will appear in the category selection area, so try to keep it below 200 characters.)

Use the following paragraphs for a longer description, or to establish category guidelines or rules:

  • Why should people use this category? What is it for?

  • How exactly is this different than the other categories we already have?

  • What should topics in this category generally contain?

  • Do we need this category? Can we merge with another category, or subcategory?

Flatland Workshop

About the Flatland Workshop category

Over 3 years ago

(Replace this first paragraph with a brief description of your new category. This guidance will appear in the category selection area, so try to keep it below 200 characters.)

Use the following paragraphs for a longer description, or to establish category guidelines or rules:

  • Why should people use this category? What is it for?

  • How exactly is this different than the other categories we already have?

  • What should topics in this category generally contain?

  • Do we need this category? Can we merge with another category, or subcategory?

Flatland

Editor.py missing package jpy_canvas

Almost 4 years ago

Hello @pf1, @hagrid67 is the authority on this matter!

Metadata.csv is missing from the latest testset

Almost 4 years ago

Hello Sahil, which archive are you referring to? I see the metadata.csv in both test-neurips2020-round2-v0.tar.gz and test-neurips2020-round1-v1.tar.gz from the Resources page.

edit: This was an error in the doc that we’ve now corrected, thanks for the report!

πŸ“‘ The Flatland paper is out!

Almost 4 years ago

A first version of the Flatland competition paper is out on arXiv!

:link: Flatland-RL : Multi-Agent Reinforcement Learning on Trains

@misc{mohanty2020flatlandrl,
      title={Flatland-RL : Multi-Agent Reinforcement Learning on Trains}, 
      author={Sharada Mohanty and Erik Nygren and Florian Laurent and Manuel Schneider and Christian Scheller and Nilabha Bhattacharya and Jeremy Watson and Adrian Egli and Christian Eichenberger and Christian Baumberger and Gereon Vienken and Irene Sturm and Guillaume Sartoretti and Giacomo Spigler},
      year={2020},
      eprint={2012.05893},
      archivePrefix={arXiv},
      primaryClass={cs.AI}
}

A separate paper will cover competition results, more information about it coming soon.

πŸ“Ή Flatland NeurIPS Townhall

Almost 4 years ago

Hey @jakob_stigenberg, yes the event was recorded, we will release the video publicly soon!

πŸ† NeurIPS 2020 Flatland Winners

Almost 4 years ago

Round 2 has finished, concluding the NeurIPS 2020 edition!

We have received over 2’000 submissions from over 700 participants coming from over 51 countries! We have been thrilled by your contributions and enthusiasm.

And the winners are… :drum:

RL Track

  • :1st_place_medal:JBR_HSE, 214.15 points
  • :2nd_place_medal:ai-team-flatland, 181.497 points
  • :3rd_place_medal:SSG-RL, 143.985 points

Non-RL Track

  • :1st_place_medal:An_Old_Driver, 297.507 points
  • :2nd_place_medal:MasterFlatland, 296.347 points
  • :3rd_place_medal:vetrov_andrew, 273.339 points

Congratulations to all of them! The race was intense :tada: :clap:

Community Prizes

In parallel to the competition, participants also competed for Community Prizes, contributing to the Flatland ecosystem by building tools and implementing ideas that will help other participants.

And the winners are:

The submissions were few, but they were very impressive and inspiring. We warmly congratulate all four winners.

What’s next?

This competition may be finished, but Flatland is just getting started!

We are happy to announce that not only will we apply for a new competition at NeurIPS next year, but we are also organizing another challenge before that in the context of the AMLD 2021 conference, which will take place in Lausanne, Switzerland. :switzerland::steam_locomotive::mountain:

Beyond competitions, Flatland will also become a long-term benchmark, accepting submissions on a permanent basis. Our goal is to measure the progress around the real-world problem of train scheduling, and progress doesn’t happen only twice a year!

For this purpose, a new β€œpost-challenge” round will be open soon and will stay open until next competition to allow the community to keep searching.

Thank you all again for your participation, and see you soon on the next leaderboard!

The official results will be announced at NeurIPS

About 4 years ago

Hello everyone,

The review process has been long and complex!

We will ultimately present the official results during the NeurIPS conference, as part of the competition track.

πŸš‡ 5 days left! Final tips & tricks for the home stretch

About 4 years ago

Hey @harshadkhadilkar, the review process took more time than expected, as it was challenging to establish if each solution was using RL in a meaningful way.

We will announce the official results at NeurIPS.

Will the leaderboard remain open?

About 4 years ago

Hello @guillaume_alleon,

Yes we plan to keep the submissions open! For now new submissions will appear under β€œpost-challenge submissions” (go to β€œLeaderboard filters” -> β€œInclude post-challenge submissions” to show them).

We will also announce the launch of the new Flatland event at NeurIPS :smiley:

This challenge has raised a lot of interest from both participants and partners, the adventure is just getting started! :rocket:

Cheers,
Florian

Submission error: weird error during conda clean

About 4 years ago

This is probably related to this: Build problem with the current `environment.yml` file

Make sure your requirements.yml only contains what’s strictly necessary!

πŸš‡ 5 days left! Final tips & tricks for the home stretch

About 4 years ago

It’s (a): you can submit until the deadline!

Different CUDA version

About 4 years ago

But, as the evaluation environment doesn’t include a GPU, do you really need to setup CUDA in your submissions?

Different CUDA version

About 4 years ago

@shivam may be able to help here?

Flatland-Visualization: Visual Analytics of Flatland Episodes

About 4 years ago

Wow, amazing work :star_struck: :clap:

It’s not clear to me how to create new regions: it seems that I need to select multiple cells by keeping my mouse pressed on the Map View? I don’t see the gray overlay on the Map View or the edges between the vertices on the Graph View

Evaluation took too long

About 4 years ago

Hello,

How do I deal with the fact that my 8h of evaluation time ran out and the percentage complete is still > 0.25

This is fine, this means your submission stopped because it reached the overall time limit instead of the β€œpercentage done” limit. Most OR submissions reach the overall timeout (you can see on the leaderboard that their mean β€œ% Done” is very high).

An early submit on the remote client results in an error and doing nothing also results in an error : Timeout : Evaluation took too long.

I don’t understand what you mean?

MasterScrat has not provided any information yet.