Activity
Ratings Progression
Challenge Categories
Challenges Entered
Understand semantic segmentation and monocular depth estimation from downward-facing drone images
Latest submissions
See Allfailed | 208886 | ||
failed | 208865 | ||
failed | 208835 |
Audio Source Separation using AI
Latest submissions
See Allgraded | 209221 | ||
graded | 209112 | ||
graded | 209110 |
Identify user photos in the marketplace
Latest submissions
See Allfailed | 209210 | ||
graded | 208987 | ||
failed | 208985 |
Amazon KDD Cup 2022
Latest submissions
Using AI For Buildingβs Energy Management
Latest submissions
See Allfailed | 205233 | ||
graded | 199053 | ||
graded | 199034 |
Learning From Human-Feedback
Latest submissions
Interactive embodied agents for Human-AI collaboration
Latest submissions
See Allgraded | 199453 | ||
graded | 199452 | ||
graded | 198521 |
What data should you label to get the most value for your money?
Latest submissions
A benchmark for image-based food recognition
Latest submissions
Specialize and Bargain in Brave New Worlds
Latest submissions
Behavioral Representation Learning from Animal Poses.
Latest submissions
See Allgraded | 198630 | ||
graded | 197504 | ||
graded | 197503 |
Airborne Object Tracking Challenge
Latest submissions
ASCII-rendered single-player dungeon crawl game
Latest submissions
See Allgraded | 158823 | ||
failed | 158209 | ||
failed | 158208 |
Latest submissions
Training sample-efficient agents in Minecraft
Latest submissions
Machine Learning for detection of early onset of Alzheimers
Latest submissions
Measure sample efficiency and generalization in reinforcement learning using procedurally generated environments
Latest submissions
Self-driving RL on DeepRacer cars - From simulation to real world
Latest submissions
See Allgraded | 165209 | ||
failed | 165208 | ||
failed | 165206 |
Robustness and teamwork in a massively multiagent environment
Latest submissions
Latest submissions
5 Puzzles 21 Days. Can you solve it all?
Latest submissions
Multi-Agent Reinforcement Learning on Trains
Latest submissions
Latest submissions
See Allgraded | 143804 | ||
graded | 125756 | ||
graded | 125751 |
5 Problems 15 Days. Can you solve it all?
Latest submissions
Learn to Recognise New Behaviors from limited training examples.
Latest submissions
See Allgraded | 125756 | ||
graded | 125589 |
Reinforcement Learning, IIT-M, assignment 1
Latest submissions
See Allgraded | 125767 | ||
submitted | 125747 | ||
graded | 125006 |
IIT-M, Reinforcement Learning, DP, Taxi Problem
Latest submissions
See Allgraded | 125767 | ||
graded | 125006 | ||
graded | 124921 |
Latest submissions
See Allgraded | 128400 | ||
submitted | 128365 |
Latest submissions
See Allfailed | 131869 | ||
graded | 130090 | ||
graded | 128401 |
Latest submissions
See Allfailed | 131869 | ||
graded | 130090 | ||
graded | 128401 |
Latest submissions
See Allgraded | 135842 | ||
graded | 130545 |
Round 1 - Completed
Latest submissions
Round 1 - Completed
Latest submissions
Identify Words from silent video inputs.
Latest submissions
Round 2 - Active | Claim AWS Credits by beating the baseline
Latest submissions
See Allgraded | 198630 | ||
graded | 182252 | ||
graded | 178951 |
Round 2 - Active | Claim AWS Credits by beating the baseline
Latest submissions
See Allgraded | 197504 | ||
graded | 197503 | ||
graded | 182254 |
Use an RL agent to build a structure with natural language inputs
Latest submissions
See Allgraded | 199453 | ||
graded | 199452 | ||
graded | 198521 |
Language assisted Human - AI Collaboration
Latest submissions
See Allgraded | 196399 | ||
graded | 196379 | ||
failed | 196363 |
Latest submissions
See Allgraded | 200962 | ||
failed | 200887 | ||
submitted | 200885 |
Estimate depth in aerial images from monocular downward-facing drone
Latest submissions
See Allfailed | 208886 | ||
failed | 208865 | ||
failed | 208835 |
Perform semantic segmentation on aerial images from monocular downward-facing drone
Latest submissions
See Allfailed | 208496 | ||
graded | 208493 | ||
failed | 208492 |
Music source separation of an audio signal into separate tracks for vocals, bass, drums, and other
Latest submissions
See Allgraded | 209221 | ||
graded | 209110 | ||
graded | 209109 |
Source separation of a cinematic audio track into dialogue, sound-effects and misc.
Latest submissions
See Allgraded | 209112 | ||
graded | 208824 | ||
graded | 208821 |
Latest submissions
See Allgraded | 206453 | ||
submitted | 206452 | ||
submitted | 206337 |
Participant | Rating |
---|---|
![]() |
0 |
![]() |
0 |
Participant | Rating |
---|
-
Random-walk Airborne Object Tracking ChallengeView
-
R2D2 NeurIPS 2022: CityLearn ChallengeView
Cinematic Sound Demixing Track - CDX'23
Questions about submissions
5 days agoLeaderboard A and B submission for MDX track are now enabled. The instructions are added here. In short, the keys βlabelnoiseβ and βbleedingβ have to be added to aicrowd.json
Aicrowd-bot adds people to my private submission repository for CDX track
9 days agoAll the users added above are part of the organizing team. By default, we provide access to the user submitted code to the organizing team to help debug any issues participants face. However, the SDX organizers categorically requested that they not have access to any user submitted code, and we have enabled the same. The organizing team will be added to any new repositories that are used for submissions. We have also retrospectively ensured that no one from the organizing team has access to any of the repositories already submitted by the participants, including yours.
SUADD'23- Scene Understanding for Autonomous Drone
π¬ Feedback and suggestion
7 days agoThe baseline was trained on the training set shared, and the current dataset used for the leaderboard was used as validation. Hence, unfortunately until that set is made public (it will be a few weeks before the end of challenge when the actual test set is ready), its not possible to reproduce the results right now.
Error in local evaluation
11 days agoWeβve updated the file in the Resources section - suadd_23_semantic_annotations-v0.2.zip
Let me know if you still get the error with the updated dataset.
π¬ Feedback and suggestion
11 days agoHi @adithya_t_p
The validation set is used for the public leaderboard, this set will be made public at a later stage in the competition as the test set is still in development by the organizers. So for now you have to make your own dataset split.
π¬ Feedback and suggestion
11 days agoThe baseline should work with this commit
Thanks for pointing it out, weβll add a note in the baseline repo.
How to install mmcv-full while submission
27 days ago@xav_c @FY1 , Please resubmit any submissions you made for which the tag didnβt reflect on the issues page. It was a problem on our end, its fixed now.
Visual Product Recognition Challenge 2023
Why my submission is failed?
10 days agoPlease ensure that your code has no hardcoded values, hardcoded dictionary keys, etc. Also make sure local evaluation works.
If youβre still unable to find the error, I can check the logs manually, but this will be slow as I might not be available always and we cannot show the logs any other way.
Why my submission is failed?
10 days agoHello,
The validation step is only a debugging dataset as we canβt give logs on the main dataset to prevent data leaks.
Can't download the public test dataset
16 days ago@tomtom , Iβm still unable to replicate the problem as the link is working for me. I tried it with my personal (non-admin account) and it still works.
Would it be possible for you to try it with a different internet connection?
Can't download the public test dataset
18 days agoHi @tomtom
Itβs working for me, could you share what error youβre getting?
Mono Depth Perception
Update in mono-depth evaluation method
12 days agoI did notice that, however your submission didnβt get NaN scores. Iβll need some time to investigate, should be resolved by tomorrow.
Update in mono-depth evaluation method
12 days agoHi Victor,
Thanks for pointing this out, the SILog had gone to NaN because your predictions were too large, I think you probably output the depth values without the scaling factor as shown in local_evaluation.py
? The submission is now marked as failed.
Please check this function for reading depth images. The values should be closer to ~1-50.
Update in mono-depth evaluation method
17 days agoHi everyone,
We have made a change in the evaluation setup, to allow for models that predict relative depth maps from mono image inputs. We now apply an alignment step to the model to align a relative depth prediction to the ground truth. For more details please refer to this paper Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfer.
Updated code for local evaluation of your models can be found in the starter-kit . All valid old submissions will be re-evaluated. All future submissions will be evaluated with these updated metrics.
Semantic Segmentation
Update in segmentation scoring metrics
23 days agoHi everyone,
We have made a change in the way metrics are calculated, to better match the standard practice used in segmentation literature. The IoU and Dice scores are now calculated per class on the entire dataset and then averaged, instead of per image. As a result, most submissions are expected to get slightly higher scores.
Updated code for local evaluation of your models can be found in the starter-kit. All valid old submissions will be re-evaluated within the next few days. All future submissions will be evaluated with these updated metrics.
Notebooks
-
[Getting Started] ETH PSC Summer School Hackathon This is a Baseline Code to get you started with the challenge.dipamΒ· 5 months ago
-
Baseline - BERT Classifier - BM25 Ranker Official baseline that uses BERT based classifier and BM25 rankerdipamΒ· 6 months ago
-
Unsupervised model - SimCLR - Ant-Beetles Video Data Unsupervised model training using contrastive learning with modified SimCLRdipamΒ· 10 months ago
-
Unsupervised model - SimCLR - Mouse Video Data Unsupervised model training using contrastive learning with modified SimCLRdipamΒ· 10 months ago
-
Getting Started - Mouse-Triplets Video Data Initial data exploration and a basic embedding using a vision modeldipamΒ· 10 months ago
-
Getting Started - Ant-Beetles Video Data Initial data exploration and a basic embedding using a vision modeldipamΒ· 10 months ago
-
BSuite Challenge Starter Kit IITM RL Final Project Bsuite starter kit with random baselinedipamΒ· Almost 2 years ago
-
Solution for submission 128367 A detailed solution for submission 128367 submitted for challenge IIT-M RL-ASSIGNMENT-2-GRIDWORLDdipamΒ· Almost 2 years ago
-
Solution for submission 130090 A detailed solution for submission 130090 submitted for challenge IIT-M RL-ASSIGNMENT-2-GRIDWORLDdipamΒ· Almost 2 years ago
-
Solution for submission 128401 A detailed solution for submission 128401 submitted for challenge IIT-M RL-ASSIGNMENT-2-GRIDWORLDdipamΒ· Almost 2 years ago
-
Solution for submission 128400 A detailed solution for submission 128400 submitted for challenge IIT-M RL-ASSIGNMENT-2-TAXIdipamΒ· Almost 2 years ago
-
Taxi Notebook IITM RL Assignment 2 Notebook to be filled for IITM RL Assingnment 2 TaxidipamΒ· Almost 2 years ago
-
Gridworld Notebook IITM RL Assignment 2 Notebook to be filled for IITM RL Assingnment 2 GridworlddipamΒ· Almost 2 years ago
Question about submission
3 days agoHi everyone,
Anyone who got a "
Submission failed : You have not qualified for this round
" previously, please retry your submissions, they should work now.