Process Videos: Evaluation timed out

Hey! This pops up randomly. I would requeue the submission but the same bug seems to make this impossible from my end .

Can you resubmit your solution? I can remove failed solutions for you so you get submission quota back

View post 0

Debug Submission with debug=false

Hmm it might have not updated because the score is has not improved over the debug submission, but this is just a finnicky thing of the leaderboard.

View post 0

Debug Submission with debug=false

It looks like the tag for the submission was done to wrong commit indeed, triggering a submission which uses code from 3 months ago. You could try doing a tag here on the main branch (remember to start with “submission-”): AIcrowd

View post 0

Debug Submission with debug=false

Hey! Make sure you have pushed the changes and that you have tagged the submission after the change. If that does not help, please share the issue page of your submission so I can take a look

View post 0

Process Videos: Error (exit code 1): Unable to find metadata.json for all environments

Hey! Sorry about this, still looking into this . The BASALT side has gotten bit more attention as it is the main track, but now those errors are fixed for now so intro track will get some love!

View post 0

Process Videos: Error (exit code 1): Unable to find metadata.json for all environments

@mohanty Would you have any idea what could be bugged up here?

View post 0

[Request] Dummy data location

@yamato.kataoka In case you missed it, the full dataset is now available here

View post 0

[Request] Dummy data location

Hey. Sorry for the headache: we are just about to share the full dataset, though, which will use the same storage method as the other OpenAI VPT data they shared! That one you will be able to curl/wget easily :). Stay tuned; we will announce this on Discord and update the AICrowd main page with the link.

View post 0

"process no longer exists" error

Hey there! The code is running correctly, it is just closing the environment that sometimes (or always) throws an error on Windows. You can ignore this error for now. If you want code to continue after calling env.close, wrap it around try-except blocks.

View post 0

Anything news for thhe mineRL competition?

Hey. Sadly there are no news as of yet, so you have not missed anything. Stuff might now how happen now that holidays are over but I can not promise when.

View post 0

Is there anyway to know i am getting hurt during inference stage?

Hey. There is no API to get this information in MineRL environments right now, so no. That info is just for aicrowd evaluation.

View post 0

About the duration of Round 1

Hey. Unfortunately the tight schedule requested by NeurIPS competition board is making it a bit difficult to extend deadlines further. We will likely only extend deadline if more technical issues crop up that require more days to handle.

View post 1

How many teams will be invited this year?

Hey! I assume this is the number of participants invited to the workshop to present their submissions etc? Ideally we would like to invite all Round 2 finalists + some from Intro track, depending on how NeurIPS workshop is structued! We will let you know when we have the exact numbers

Prizes are to be determined (but they are coming!)

View post 0

Question about timeline of research track round II

The deadline was set to 15th October initially, but rules indeed make it sound different.

I will let Nicholay (our rules guy) answer the question for final confirmation

View post 0

Can i select dataset in any ways?

Hey! Sorry for the delay (we are more active on the Discord server).

In Intro track, you are free to use the data in any way possible. In Research track, however, you are not allowed to have such fine-grained selection (unless it is selected by a trained neural network).

View post 0

Network problem leading fail to build image consume submission quota

Ah! I assume you refer to the figure here? https://github.com/minerllabs/competition_submission_template (Edit: I have removed the said figure from the github page. It had text “max. 20 submissions”)

That information is wrong, and for now there are unlimited number of submissions (but with a daily cap). Thanks for pointing this out tho! I will fix it.

Failed submissions are counted as submissions as well, as long they started the building stage (this, too, takes quite a bit of resources to run).

View post 1

Network problem leading fail to build image consume submission quota

Hey. The submission quota refreshes daily, but in a pinch @Shivam or someone else from AICrowd can requeue your submission if it fails in docker build phase (sorry, I did not notice your message on gitlab up until now).

View post 0

What is the hardware configuration of online machine for research track?

Nope, no per-step limitations. I would recommend that the MineRL environment will work if you have very long delays between step calls (it should not matter, but easier to check locally than on the evaluation server )

View post 0

Error of running the BC baseline code

Judging by when bc.py was added, this is the imitation version that could work.

View post 0

Error of running the BC baseline code

Hey! Sorry for the delay!

The baseline code was tested to work during release but sadly it seems like some of the dependencies have been updated since and it breaks this code . My wild guess is that imitation repository has changed. Your best bet is to checkout older version of imitation and installing that (a manual process…).

An easier step would be to double-check you have the up-to-date library versions as specified by environment.yml, but I assume this is already the case.

View post 0