Loading
4 Follower
2 Following
anssi

Organization

Microsoft Research

Location

GB

Badges

3
2
2

Connect

Activity

Dec
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
Mon
Wed
Fri

Ratings Progression

Loading...

Challenge Categories

Loading...

Challenges Entered

Latest submissions

See All
failed 196478
failed 196122
failed 196036

ASCII-rendered single-player dungeon crawl game

Latest submissions

See All
graded 163412
graded 162954
graded 159431

Latest submissions

See All
graded 149932
graded 149876
failed 149858

Sample Efficient Reinforcement Learning in Minecraft

Latest submissions

See All
graded 150594
graded 150579
failed 150215

Measure sample efficiency and generalization in reinforcement learning using procedurally generated environments

Latest submissions

No submissions made in this challenge.

Robustness and teamwork in a massively multiagent environment

Latest submissions

No submissions made in this challenge.

3D Seismic Image Interpretation by Machine Learning

Latest submissions

See All
graded 83204
graded 82875
failed 82870

Sample-efficient reinforcement learning in Minecraft

Latest submissions

See All
graded 117319
graded 107745
graded 107322

Sample-efficient reinforcement learning in Minecraft

Latest submissions

See All
failed 25431
graded 25415
graded 25316

A new benchmark for Artificial Intelligence (AI) research in Reinforcement Learning

Latest submissions

See All
graded 8597
graded 8541
graded 8531

Latest submissions

No submissions made in this challenge.

Latest submissions

See All
graded 150594
graded 150579
Participant Rating
MasterScrat 229
shivam 136
vrv 0
araffin 0
Participant Rating
shivam 136
MasterScrat 229

NeurIPS 2022: MineRL BASALT Competition

Process Videos: Evaluation timed out

About 1 year ago

Hey! This pops up randomly. I would requeue the submission but the same bug seems to make this impossible from my end :frowning: .

Can you resubmit your solution? I can remove failed solutions for you so you get submission quota back

Debug Submission with debug=false

About 1 year ago

Hmm it might have not updated because the score is has not improved over the debug submission, but this is just a finnicky thing of the leaderboard.

Debug Submission with debug=false

About 1 year ago

It looks like the tag for the submission was done to wrong commit indeed, triggering a submission which uses code from 3 months ago. You could try doing a tag here on the main branch (remember to start with “submission-”): AIcrowd

Debug Submission with debug=false

About 1 year ago

Hey! Make sure you have pushed the changes and that you have tagged the submission after the change. If that does not help, please share the issue page of your submission so I can take a look :slight_smile:

Process Videos: Error (exit code 1): Unable to find metadata.json for all environments

About 1 year ago

Hey! Sorry about this, still looking into this :sweat_smile: . The BASALT side has gotten bit more attention as it is the main track, but now those errors are fixed for now so intro track will get some love!

Process Videos: Error (exit code 1): Unable to find metadata.json for all environments

About 1 year ago

@mohanty Would you have any idea what could be bugged up here?

[Request] Dummy data location

Over 1 year ago

@yamato.kataoka In case you missed it, the full dataset is now available here :slight_smile:

[Request] Dummy data location

Over 1 year ago

Hey. Sorry for the headache: we are just about to share the full dataset, though, which will use the same storage method as the other OpenAI VPT data they shared! That one you will be able to curl/wget easily :). Stay tuned; we will announce this on Discord and update the AICrowd main page with the link.

"process no longer exists" error

Over 1 year ago

Hey there! The code is running correctly, it is just closing the environment that sometimes (or always) throws an error on Windows. You can ignore this error for now. If you want code to continue after calling env.close, wrap it around try-except blocks.

NeurIPS 2021: MineRL Diamond Competition

Anything news for thhe mineRL competition?

Almost 2 years ago

Hey. Sadly there are no news as of yet, so you have not missed anything. Stuff might now how happen now that holidays are over but I can not promise when.

Is there anyway to know i am getting hurt during inference stage?

About 2 years ago

Hey. There is no API to get this information in MineRL environments right now, so no. That info is just for aicrowd evaluation.

About the duration of Round 1

About 2 years ago

Hey. Unfortunately the tight schedule requested by NeurIPS competition board is making it a bit difficult to extend deadlines further. We will likely only extend deadline if more technical issues crop up that require more days to handle.

How many teams will be invited this year?

About 2 years ago

Hey! I assume this is the number of participants invited to the workshop to present their submissions etc? Ideally we would like to invite all Round 2 finalists + some from Intro track, depending on how NeurIPS workshop is structued! We will let you know when we have the exact numbers :slight_smile:

Prizes are to be determined (but they are coming!)

Question about timeline of research track round II

About 2 years ago

The deadline was set to 15th October initially, but rules indeed make it sound different.

I will let Nicholay (our rules guy) answer the question for final confirmation :slight_smile:

Can i select dataset in any ways?

About 2 years ago

Hey! Sorry for the delay (we are more active on the Discord server).

In Intro track, you are free to use the data in any way possible. In Research track, however, you are not allowed to have such fine-grained selection (unless it is selected by a trained neural network).

Network problem leading fail to build image consume submission quota

About 2 years ago

Ah! I assume you refer to the figure here? https://github.com/minerllabs/competition_submission_template (Edit: I have removed the said figure from the github page. It had text “max. 20 submissions”)

That information is wrong, and for now there are unlimited number of submissions (but with a daily cap). Thanks for pointing this out tho! I will fix it.

Failed submissions are counted as submissions as well, as long they started the building stage (this, too, takes quite a bit of resources to run).

Network problem leading fail to build image consume submission quota

About 2 years ago

Hey. The submission quota refreshes daily, but in a pinch @Shivam or someone else from AICrowd can requeue your submission if it fails in docker build phase (sorry, I did not notice your message on gitlab up until now).

What is the hardware configuration of online machine for research track?

About 2 years ago

Nope, no per-step limitations. I would recommend that the MineRL environment will work if you have very long delays between step calls (it should not matter, but easier to check locally than on the evaluation server :slight_smile: )

NeurIPS 2021: MineRL BASALT Competition

Error of running the BC baseline code

About 2 years ago

Hey! Sorry for the delay!

The baseline code was tested to work during release but sadly it seems like some of the dependencies have been updated since and it breaks this code :frowning: . My wild guess is that imitation repository has changed. Your best bet is to checkout older version of imitation and installing that (a manual process…).

An easier step would be to double-check you have the up-to-date library versions as specified by environment.yml, but I assume this is already the case.

anssi has not provided any information yet.