Loading

IIT-M RL-ASSIGNMENT-2-TAXI

Solution for submission 128368

A detailed solution for submission 128368 submitted for challenge IIT-M RL-ASSIGNMENT-2-TAXI

jyotish

What is the notebook about?

Problem - Taxi Environment Algorithms

This problem deals with a taxi environment and stochastic actions. The tasks you have to do are:

  • Implement Policy Iteration
  • Implement Modified Policy Iteration
  • Implement Value Iteration
  • Implement Gauss Seidel Value Iteration
  • Visualize the results
  • Explain the results

How to use this notebook? 📝

  • This is a shared template and any edits you make here will not be saved.You should make a copy in your own drive. Click the "File" menu (top-left), then "Save a Copy in Drive". You will be working in your copy however you like.

  • Update the config parameters. You can define the common variables here

Variable Description
AICROWD_DATASET_PATH Path to the file containing test data. This should be an absolute path.
AICROWD_RESULTS_DIR Path to write the output to.
AICROWD_ASSETS_DIR In case your notebook needs additional files (like model weights, etc.,), you can add them to a directory and specify the path to the directory here (please specify relative path). The contents of this directory will be sent to AIcrowd for evaluation.
AICROWD_API_KEY In order to submit your code to AIcrowd, you need to provide your account's API key. This key is available at https://www.aicrowd.com/participants/me

Setup AIcrowd Utilities 🛠

We use this to bundle the files for submission and create a submission on AIcrowd. Do not edit this block.

In [8]:
!pip install aicrowd-cli
Requirement already satisfied: aicrowd-cli in /usr/local/lib/python3.7/dist-packages (0.1.2)
Requirement already satisfied: tqdm<5,>=4.56.0 in /usr/local/lib/python3.7/dist-packages (from aicrowd-cli) (4.59.0)
Requirement already satisfied: click<8,>=7.1.2 in /usr/local/lib/python3.7/dist-packages (from aicrowd-cli) (7.1.2)
Requirement already satisfied: requests<3,>=2.25.1 in /usr/local/lib/python3.7/dist-packages (from aicrowd-cli) (2.25.1)
Requirement already satisfied: toml<1,>=0.10.2 in /usr/local/lib/python3.7/dist-packages (from aicrowd-cli) (0.10.2)
Requirement already satisfied: rich<11,>=10.0.0 in /usr/local/lib/python3.7/dist-packages (from aicrowd-cli) (10.1.0)
Requirement already satisfied: requests-toolbelt<1,>=0.9.1 in /usr/local/lib/python3.7/dist-packages (from aicrowd-cli) (0.9.1)
Requirement already satisfied: gitpython<4,>=3.1.12 in /usr/local/lib/python3.7/dist-packages (from aicrowd-cli) (3.1.14)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/local/lib/python3.7/dist-packages (from requests<3,>=2.25.1->aicrowd-cli) (1.24.3)
Requirement already satisfied: chardet<5,>=3.0.2 in /usr/local/lib/python3.7/dist-packages (from requests<3,>=2.25.1->aicrowd-cli) (3.0.4)
Requirement already satisfied: idna<3,>=2.5 in /usr/local/lib/python3.7/dist-packages (from requests<3,>=2.25.1->aicrowd-cli) (2.10)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.7/dist-packages (from requests<3,>=2.25.1->aicrowd-cli) (2020.12.5)
Requirement already satisfied: commonmark<0.10.0,>=0.9.0 in /usr/local/lib/python3.7/dist-packages (from rich<11,>=10.0.0->aicrowd-cli) (0.9.1)
Requirement already satisfied: colorama<0.5.0,>=0.4.0 in /usr/local/lib/python3.7/dist-packages (from rich<11,>=10.0.0->aicrowd-cli) (0.4.4)
Requirement already satisfied: pygments<3.0.0,>=2.6.0 in /usr/local/lib/python3.7/dist-packages (from rich<11,>=10.0.0->aicrowd-cli) (2.6.1)
Requirement already satisfied: typing-extensions<4.0.0,>=3.7.4 in /usr/local/lib/python3.7/dist-packages (from rich<11,>=10.0.0->aicrowd-cli) (3.7.4.3)
Requirement already satisfied: gitdb<5,>=4.0.1 in /usr/local/lib/python3.7/dist-packages (from gitpython<4,>=3.1.12->aicrowd-cli) (4.0.7)
Requirement already satisfied: smmap<5,>=3.0.1 in /usr/local/lib/python3.7/dist-packages (from gitdb<5,>=4.0.1->gitpython<4,>=3.1.12->aicrowd-cli) (4.0.0)

AIcrowd Runtime Configuration 🧷

Get login API key from https://www.aicrowd.com/participants/me

In [9]:
import os

AICROWD_DATASET_PATH = os.getenv("DATASET_PATH", os.getcwd()+"/13d77bb0-b325-4e95-a03b-833eb6694acd_a2_taxi_inputs.zip")
AICROWD_RESULTS_DIR = os.getenv("OUTPUTS_DIR", "results")
In [10]:

API Key valid
Saved API Key successfully!
13d77bb0-b325-4e95-a03b-833eb6694acd_a2_taxi_inputs.zip: 100% 31.2k/31.2k [00:00<00:00, 264kB/s]
In [11]:
!unzip -q $AICROWD_DATASET_PATH
replace inputs/inputs_base.npy? [y]es, [n]o, [A]ll, [N]one, [r]ename: N
In [12]:
DATASET_DIR = 'inputs/'

Taxi Environment

Read the environment to understand the functions, but do not edit anything

In [13]:
import numpy as np

class TaxiEnv_HW2:
    def __init__(self, states, actions, probabilities, rewards, initial_policy):
        self.possible_states = states
        self._possible_actions = {st: ac for st, ac in zip(states, actions)}
        self._ride_probabilities = {st: pr for st, pr in zip(states, probabilities)}
        self._ride_rewards = {st: rw for st, rw in zip(states, rewards)}
        self.initial_policy = initial_policy
        self._verify()

    def _check_state(self, state):
        assert state in self.possible_states, "State %s is not a valid state" % state

    def _verify(self):
        """ 
        Verify that data conditions are met:
        Number of actions matches shape of next state and actions
        Every probability distribution adds up to 1 
        """
        ns = len(self.possible_states)
        for state in self.possible_states:
            ac = self._possible_actions[state]
            na = len(ac)

            rp = self._ride_probabilities[state]
            assert np.all(rp.shape == (na, ns)), "Probabilities shape mismatch"
        
            rr = self._ride_rewards[state]
            assert np.all(rr.shape == (na, ns)), "Rewards shape mismatch"

            assert np.allclose(rp.sum(axis=1), 1), "Probabilities don't add up to 1"

    def possible_actions(self, state):
        """ Return all possible actions from a given state """
        self._check_state(state)
        return self._possible_actions[state]

    def ride_probabilities(self, state, action):
        """ 
        Returns all possible ride probabilities from a state for a given action
        For every action a list with the returned with values in the same order as self.possible_states
        """
        actions = self.possible_actions(state)
        ac_idx = actions.index(action)
        return self._ride_probabilities[state][ac_idx]

    def ride_rewards(self, state, action):
        actions = self.possible_actions(state)
        ac_idx = actions.index(action)
        return self._ride_rewards[state][ac_idx]

Example of Environment usage

In [14]:
def check_taxienv():
    # These are the values as used in the pdf, but they may be changed during submission, so do not hardcode anything

    states = ['A', 'B', 'C']

    actions = [['1','2','3'], ['1','2'], ['1','2','3']]

    probs = [np.array([[1/2,  1/4,  1/4],
                    [1/16, 3/4,  3/16],
                    [1/4,  1/8,  5/8]]),

            np.array([[1/2,   0,     1/2],
                    [1/16,  7/8,  1/16]]),

            np.array([[1/4,  1/4,  1/2],
                    [1/8,  3/4,  1/8],
                    [3/4,  1/16, 3/16]]),]

    rewards = [np.array([[10,  4,  8],
                        [ 8,  2,  4],
                        [ 4,  6,  4]]),

            np.array([[14,  0, 18],
                        [ 8, 16,  8]]),

            np.array([[10,  2,  8],
                        [6,   4,  2],
                        [4,   0,  8]]),]
    initial_policy = {'A': '1', 'B': '1', 'C': '1'}

    env = TaxiEnv_HW2(states, actions, probs, rewards, initial_policy)
    print("All possible states", env.possible_states)
    print("All possible actions from state B", env.possible_actions('B'))
    print("Ride probabilities from state A with action 2", env.ride_probabilities('A', '2'))
    print("Ride rewards from state C with action 3", env.ride_rewards('C', '3'))

    base_kwargs = {"states": states, "actions": actions, 
                "probabilities": probs, "rewards": rewards,
                "initial_policy": initial_policy}
    return base_kwargs

base_kwargs = check_taxienv()
env = TaxiEnv_HW2(**base_kwargs)
All possible states ['A', 'B', 'C']
All possible actions from state B ['1', '2']
Ride probabilities from state A with action 2 [0.0625 0.75   0.1875]
Ride rewards from state C with action 3 [4 0 8]

Task 1 - Policy Iteration

Run policy iteration on the environment and generate the policy and expected reward

In [15]:
# 1.1 Policy Iteration
def policy_iteration(taxienv, gamma):
    # A list of all the states
    states = taxienv.possible_states
    # Initial values
    values = {s: 0 for s in states}

    # This is a dictionary of states to policies -> e.g {'A': '1', 'B': '2', 'C': '1'}
    policy = taxienv.initial_policy.copy()

    ## Begin code here

    # Hints - 
    # Do not hardcode anything
    # Only the final result is required for the results
    # Put any extra data in "extra_info" dictonary for any plots etc
    # Use the helper functions taxienv.ride_rewards, taxienv.ride_probabilities,  taxienv.possible_actions
    # For terminating condition use the condition exactly mentioned in the pdf

    while True:
        while True:
            next_values = values.copy()
            for s in states:
                a = policy[s]
                rewards = taxienv.ride_rewards(s, a)
                probs = taxienv.ride_probabilities(s, a)
                nv = 0
                for si, ns in enumerate(states):
                    nv += probs[si] * (rewards[si] + gamma * values[ns])
                next_values[s] = nv
            delta = max([abs(next_values[ss]-values[ss]) for ss in states])
            values = next_values.copy()
            if delta < 1e-8:
                break

        next_policy = policy.copy()
        for s in states:
            pa = taxienv.possible_actions(s)
            action_values = []
            for a in pa:
                rewards = taxienv.ride_rewards(s, a)
                probs = taxienv.ride_probabilities(s, a)
                nv = 0
                for si, ns in enumerate(states):
                    nv += probs[si] * (rewards[si] + gamma * values[ns])
                action_values.append(nv)
            action_index = np.argmax(action_values)
            next_policy[s] = pa[action_index]
        
        if next_policy == policy:
            break
        policy = next_policy.copy()

    # Put your extra information needed for plots etc in this dictionary
    extra_info = {}

    ## Do not edit below this line

    # Final results
    return {"Expected Reward": values, "Policy": policy}, extra_info

Task 2 - Policy Iteration for multiple values of gamma

Ideally this code should run as is

In [16]:
# 1.2 Policy Iteration with different values of gamma
def run_policy_iteration(env):
    gamma_values = np.arange(5, 100, 5)/100
    results, extra_info = {}, {}
    for gamma in gamma_values:
        results[gamma], extra_info[gamma] = policy_iteration(env, gamma)
    return results, extra_info

results, extra_info = run_policy_iteration(env)

Task 3 - Modifed Policy Iteration

Implement modified policy iteration (where Value iteration is done for fixed m number of steps)

In [17]:
# 1.3 Modified Policy Iteration
def modified_policy_iteration(taxienv, gamma, m):
    # A list of all the states
    states = taxienv.possible_states
    # Initial values
    values = {s: 0 for s in states}

    # This is a dictionary of states to policies -> e.g {'A': '1', 'B': '2', 'C': '1'}
    policy = taxienv.initial_policy.copy()

    ## Begin code here

    # Hints - 
    # Do not hardcode anything
    # Only the final result is required for the results
    # Put any extra data in "extra_info" dictonary for any plots etc
    # Use the helper functions taxienv.ride_rewards, taxienv.ride_probabilities,  taxienv.possible_actions
    # For terminating condition use the condition exactly mentioned in the pdf
    
    while True:
        for _ in range(m):
            next_values = values.copy()
            for s in states:
                a = policy[s]
                rewards = taxienv.ride_rewards(s, a)
                probs = taxienv.ride_probabilities(s, a)
                nv = 0
                for si, ns in enumerate(states):
                    nv += probs[si] * (rewards[si] + gamma * values[ns])
                next_values[s] = nv
            delta = max([abs(next_values[ss]-values[ss]) for ss in states])
            values = next_values.copy()
            if delta < 1e-8:
                break
        
        next_policy = policy.copy()    
        for s in states:
            pa = taxienv.possible_actions(s)
            action_values = []
            for a in pa:
                rewards = taxienv.ride_rewards(s, a)
                probs = taxienv.ride_probabilities(s, a)
                nv = 0
                for si, ns in enumerate(states):
                    nv += probs[si] * (rewards[si] + gamma * values[ns])
                action_values.append(nv)
            action_index = np.argmax(action_values)
            next_policy[s] = pa[action_index]
        
        if next_policy == policy:
            break
        policy = next_policy.copy()

    # Put your extra information needed for plots etc in this dictionary
    extra_info = {}

    ## Do not edit below this line


    # Final results
    return {"Expected Reward": values, "Policy": policy}, extra_info

Task 4 Modified policy iteration for multiple values of m

Ideally this code should run as is

In [18]:
def run_modified_policy_iteration(env):
    m_values = np.arange(1, 15)
    gamma = 0.9
    results, extra_info = {}, {}
    for m in m_values:
        results[m], extra_info[m] = modified_policy_iteration(env, gamma, m)
    return results, extra_info

results, extra_info = run_modified_policy_iteration(env)

Task 5 Value Iteration

Implement value iteration and find the policy and expected rewards

In [19]:
# 1.4 Value Iteration
def value_iteration(taxienv, gamma):
    # A list of all the states
    states = taxienv.possible_states
    # Initial values
    values = {s: 0 for s in states}

    # This is a dictionary of states to policies -> e.g {'A': '1', 'B': '2', 'C': '1'}
    policy = taxienv.initial_policy.copy()

    ## Begin code here

    # Hints - 
    # Do not hardcode anything
    # Only the final result is required for the results
    # Put any extra data in "extra_info" dictonary for any plots etc
    # Use the helper functions taxienv.ride_rewards, taxienv.ride_probabilities,  taxienv.possible_actions
    # For terminating condition use the condition exactly mentioned in the pdf

    while True:
        next_values = values.copy()
        for s in states:
            pa = taxienv.possible_actions(s)
            action_values = []
            for a in pa:
                rewards = taxienv.ride_rewards(s, a)
                probs = taxienv.ride_probabilities(s, a)
                nv = 0
                for si, ns in enumerate(states):
                    nv += probs[si] * (rewards[si] + gamma * values[ns])
                action_values.append(nv)
            next_values[s] = max(action_values)
            action_index = np.argmax(action_values)
            policy[s] = pa[action_index]

        delta = max([abs(next_values[ss]-values[ss]) for ss in states])
        values = next_values.copy()
        if delta < 1e-8:
            break

    # Put your extra information needed for plots etc in this dictionary
    extra_info = {}

    ## Do not edit below this line

    # Final results
    return {"Expected Reward": values, "Policy": policy}, extra_info

Task 6 Value Iteration with multiple values of gamma

Ideally this code should run as is

In [20]:
def run_value_iteration(env):
    gamma_values = np.arange(5, 100, 5)/100
    results = {}
    results, extra_info = {}, {}
    for gamma in gamma_values:
        results[gamma], extra_info[gamma] = value_iteration(env, gamma)
    return results, extra_info
  
results, extra_info = run_value_iteration(env)

Task 7 Gauss Seidel Value Iteration

Implement Gauss Seidel Value Iteration

In [21]:
# 1.4 Gauss Seidel Value Iteration
def gauss_seidel_value_iteration(taxienv, gamma):
    # A list of all the states
    # For Gauss Seidel Value Iteration - iterate through the values in the same order
    states = taxienv.possible_states

    # Initial values
    values = {s: 0 for s in states}

    # This is a dictionary of states to policies -> e.g {'A': '1', 'B': '2', 'C': '1'}
    policy = taxienv.initial_policy.copy()

    # Hints - 
    # Do not hardcode anything
    # For Gauss Seidel Value Iteration - iterate through the values in the same order as taxienv.possible_states
    # Only the final result is required for the results
    # Put any extra data in "extra_info" dictonary for any plots etc
    # Use the helper functions taxienv.ride_rewards, taxienv.ride_probabilities,  taxienv.possible_actions
    # For terminating condition use the condition exactly mentioned in the pdf

    ## Begin code here
    while True:
        delta = 0
        for s in states:
            pa = taxienv.possible_actions(s)
            action_values = []
            for a in pa:
                rewards = taxienv.ride_rewards(s, a)
                probs = taxienv.ride_probabilities(s, a)
                nv = 0
                for si, ns in enumerate(states):
                    nv += probs[si] * (rewards[si] + gamma * values[ns])
                action_values.append(nv)
            next_value = max(action_values)
            delta = max( [delta, abs(next_value-values[s]) ])
            values[s] = next_value
            action_index = np.argmax(action_values)
            policy[s] = pa[action_index]
            
        if delta < 1e-8:
            break

    
    # Put your extra information needed for plots etc in this dictionary
    extra_info = {}

    ## Do not edit below this line

    # Final results
    return {"Expected Reward": values, "Policy": policy}, extra_info

Task 8 Gauss Seidel Value Iteration with multiple values of gamma

Ideally this code should run as is

In [22]:
def run_gauss_seidel_value_iteration(env):
    gamma_values = np.arange(5, 100, 5)/100
    results = {}
    results, extra_info = {}, {}
    for gamma in gamma_values:
        results[gamma], extra_info[gamma] = gauss_seidel_value_iteration(env, gamma)
    return results, extra_info
  
results, extra_info = run_gauss_seidel_value_iteration(env)

Generate Results ✅

In [23]:
# Do not edit this cell
def get_results(kwargs):

    taxienv = TaxiEnv_HW2(**kwargs)

    policy_iteration_results = run_policy_iteration(taxienv)[0]
    modified_policy_iteration_results = run_modified_policy_iteration(taxienv)[0]
    value_iteration_results = run_value_iteration(taxienv)[0]
    gs_vi_results = run_gauss_seidel_value_iteration(taxienv)[0]

    final_results = {}
    final_results["policy_iteration"] = policy_iteration_results
    final_results["modifed_policy_iteration"] = modified_policy_iteration_results
    final_results["value_iteration"] = value_iteration_results
    final_results["gauss_seidel_iteration"] = gs_vi_results

    return final_results
In [24]:
# Do not edit this cell, generate results with it as is
AICROWD_RESULTS_DIR = os.path.join('results')
if not os.path.exists(AICROWD_RESULTS_DIR):
    os.mkdir(AICROWD_RESULTS_DIR)

for params_file in os.listdir(DATASET_DIR):
  kwargs = np.load(os.path.join(DATASET_DIR, params_file), allow_pickle=True).item()
  results = get_results(kwargs)
  idx = params_file.split('_')[-1][:-4]
  np.save(os.path.join(AICROWD_RESULTS_DIR, 'results_' + idx), results)

Check your local score

In [25]:
# Check your score on the given test cases (There are more private test cases not provided)
target_folder = 'targets'
result_folder = AICROWD_RESULTS_DIR

def check_algo_match(results, targets):
    param_matches = []
    for k in results:
        param_results = results[k]
        param_targets = targets[k]
        policy_match = param_results['Policy'] == param_targets['Policy']
        rv = [v for k, v in param_results['Expected Reward'].items()]
        tv = [v for k, v in param_targets['Expected Reward'].items()]
        rewards_match = np.allclose(rv, tv, rtol=3)
        equal = rewards_match and policy_match
        param_matches.append(equal)
    return np.mean(param_matches)

def check_score(target_folder, result_folder):
    match = []
    for out_file in os.listdir(result_folder):
        res_file = os.path.join(result_folder, out_file)
        results = np.load(res_file, allow_pickle=True).item()
        idx = out_file.split('_')[-1][:-4]  # Extract the file number
        target_file = os.path.join(target_folder, f"targets_{idx}.npy")
        targets = np.load(target_file, allow_pickle=True).item()
        algo_match = []
        for k in targets:
            algo_results = results[k]
            algo_targets = targets[k]
            algo_match.append(check_algo_match(algo_results, algo_targets))
        match.append(np.mean(algo_match))
    return np.mean(match)

if os.path.exists(target_folder):
    print("Shared data Score (normalized to 1):", check_score(target_folder, result_folder))
Shared data Score (normalized to 1): 1.0

Subjective questions

Visualize results of Policy Iteration with multiple values of gamma

Add code to visualize the results

In [26]:
## Visualize policy iteration with multiple values of gamma

How are values of $\gamma$ affecting results of policy iteration

Modify this cell/add code for your answer.

Compare and contrast the behavior of Value Iteration and Gauss Seidel Value Iteraton

Add code/markdown as required

Submit to AIcrowd 🚀

In [27]:
!DATASET_PATH=$AICROWD_DATASET_PATH aicrowd notebook submit -c iit-m-rl-assignment-2-taxi -a assets
WARNING: No assets directory at assets... Creating one...
No jupyter lab module found. Using jupyter notebook.
Using notebook: /content/Copy%20of%20IITM_Assignment_2_Taxi_Solution.ipynb for submission...
Mounting Google Drive 💾
Your Google Drive will be mounted to access the colab notebook
Go to this URL in a browser: https://accounts.google.com/o/oauth2/auth?client_id=947318989803-6bn6qk8qdgf4n4g3pfee6491hc0brc4i.apps.googleusercontent.com&redirect_uri=urn%3aietf%3awg%3aoauth%3a2.0%3aoob&scope=email%20https%3a%2f%2fwww.googleapis.com%2fauth%2fdocs.test%20https%3a%2f%2fwww.googleapis.com%2fauth%2fdrive%20https%3a%2f%2fwww.googleapis.com%2fauth%2fdrive.photos.readonly%20https%3a%2f%2fwww.googleapis.com%2fauth%2fpeopleapi.readonly%20https%3a%2f%2fwww.googleapis.com%2fauth%2fdrive.activity.readonly%20https%3a%2f%2fwww.googleapis.com%2fauth%2fexperimentsandconfigs%20https%3a%2f%2fwww.googleapis.com%2fauth%2fphotos.native&response_type=code

Enter your authorization code:
4/1AY0e-g6HEs26IHdgn33MFXJgx5ATA9apkE1yleidI-APdYQWCbQfj5ac-j0
Mounted at /content/drive
No jupyter lab module found. Using jupyter notebook.
Scrubbing API keys from the notebook...
Collecting notebook...
No jupyter lab module found. Using jupyter notebook.
Validating the submission...
Executing install.ipynb...
[NbConvertApp] Converting notebook /content/submission/install.ipynb to notebook
[NbConvertApp] Executing notebook with kernel: python3
[NbConvertApp] Writing 696 bytes to /content/submission/install.nbconvert.ipynb
Executing predict.ipynb...
[NbConvertApp] Converting notebook /content/submission/predict.ipynb to notebook
[NbConvertApp] Executing notebook with kernel: python3
[NbConvertApp] ERROR | unhandled iopub msg: colab_request
[NbConvertApp] ERROR | unhandled iopub msg: colab_request
[NbConvertApp] ERROR | unhandled iopub msg: colab_request
[NbConvertApp] ERROR | unhandled iopub msg: colab_request
[NbConvertApp] ERROR | unhandled iopub msg: colab_request
[NbConvertApp] ERROR | unhandled iopub msg: colab_request
[NbConvertApp] Writing 37781 bytes to /content/submission/predict.nbconvert.ipynb
╭───────────────────── Traceback (most recent call last) ──────────────────────╮
 /usr/local/bin/aicrowd:8 in <module>                                         
                                                                              
   5 from aicrowd.cli import cli                                              
   6 if __name__ == '__main__':                                               
   7 │   sys.argv[0] = re.sub(r'(-script\.pyw|\.exe)?$', '', sys.argv[0])     
 8 │   sys.exit(cli())                                                      
                                                                              
 /usr/local/lib/python3.7/dist-packages/click/core.py:829 in __call__         
                                                                              
    826 │                                                                     
    827 │   def __call__(self, *args, **kwargs):                              
    828 │   │   """Alias for :meth:`main`."""                                 
  829 │   │   return self.main(*args, **kwargs)                             
    830                                                                       
    831                                                                       
    832 class Command(BaseCommand):                                           
                                                                              
 /usr/local/lib/python3.7/dist-packages/click/core.py:782 in main             
                                                                              
    779 │   │   try:                                                          
    780 │   │   │   try:                                                      
    781 │   │   │   │   with self.make_context(prog_name, args, **extra) as c 
  782 │   │   │   │   │   rv = self.invoke(ctx)                             
    783 │   │   │   │   │   if not standalone_mode:                           
    784 │   │   │   │   │   │   return rv                                     
    785 │   │   │   │   │   # it's not safe to `ctx.exit(rv)` here!           
                                                                              
 /usr/local/lib/python3.7/dist-packages/click/core.py:1259 in invoke          
                                                                              
   1256 │   │   │   │   Command.invoke(self, ctx)                             
   1257 │   │   │   │   sub_ctx = cmd.make_context(cmd_name, args, parent=ctx 
   1258 │   │   │   │   with sub_ctx:                                         
 1259 │   │   │   │   │   return _process_result(sub_ctx.command.invoke(sub 
   1260 │   │                                                                 
   1261 │   │   # In chain mode we create the contexts step by step, but afte 
   1262 │   │   # base command has been invoked.  Because at that point we do 
                                                                              
 /usr/local/lib/python3.7/dist-packages/click/core.py:1259 in invoke          
                                                                              
   1256 │   │   │   │   Command.invoke(self, ctx)                             
   1257 │   │   │   │   sub_ctx = cmd.make_context(cmd_name, args, parent=ctx 
   1258 │   │   │   │   with sub_ctx:                                         
 1259 │   │   │   │   │   return _process_result(sub_ctx.command.invoke(sub 
   1260 │   │                                                                 
   1261 │   │   # In chain mode we create the contexts step by step, but afte 
   1262 │   │   # base command has been invoked.  Because at that point we do 
                                                                              
 /usr/local/lib/python3.7/dist-packages/click/core.py:1066 in invoke          
                                                                              
   1063 │   │   """                                                           
   1064 │   │   _maybe_show_deprecated_notice(self)                           
   1065 │   │   if self.callback is not None:                                 
 1066 │   │   │   return ctx.invoke(self.callback, **ctx.params)            
   1067                                                                       
   1068                                                                       
   1069 class MultiCommand(Command):                                          
                                                                              
 /usr/local/lib/python3.7/dist-packages/click/core.py:610 in invoke           
                                                                              
    607 │   │   args = args[2:]                                               
    608 │   │   with augment_usage_errors(self):                              
    609 │   │   │   with ctx:                                                 
  610 │   │   │   │   return callback(*args, **kwargs)                      
    611 │                                                                     
    612 │   def forward(*args, **kwargs):  # noqa: B902                       
    613 │   │   """Similar to :meth:`invoke` but fills in default keyword     
                                                                              
 /usr/local/lib/python3.7/dist-packages/aicrowd/cmd/notebook.py:92 in         
 submit_subcommand                                                            
                                                                              
    89 │   │   output,                                                        
    90 │   │   notebook_name,                                                 
    91 │   │   no_verify,                                                     
  92 │   │   dry_run,                                                       
    93 │   )                                                                  
                                                                              
 /usr/local/lib/python3.7/dist-packages/aicrowd/notebook/submit.py:94 in      
 create_submission                                                            
                                                                              
   91 │   │   │   challenge=challenge,                                        
   92 │   │   │   file_path=submission_zip_path,                              
   93 │   │   │   description=description,                                    
 94 │   │   │   print_links=True,                                           
   95 │   │   )                                                               
                                                                              
 /usr/local/lib/python3.7/dist-packages/aicrowd/submission/create_cmd.py:90   
 in create                                                                    
                                                                              
   87 │   if file_path is None:                                               
   88 │   │   raise NotImplementedError("Git based submissions are not ready  
   89 │                                                                       
 90 │   return submit_file(challenge_slug, file_path, description, api_key, 
                                                                              
 /usr/local/lib/python3.7/dist-packages/aicrowd/submission/helpers.py:346 in  
 submit_file                                                                  
                                                                              
   343 │   │   │   "Error in getting presigned url for s3 upload: %s",        
   344 │   │   │   s3_presigned_details.get("message"),                       
   345 │   │   )                                                              
 346 │   │   raise SubmissionUploadException(s3_presigned_details.get("mess 
   347 │                                                                      
   348 │   s3_key = upload_submission(                                        
   349 │   │   s3_presigned_details["url"], s3_presigned_details["fields"], f 
╰──────────────────────────────────────────────────────────────────────────────╯
SubmissionUploadException: Please accept challenge terms before making 
submission here: www.aicrowd.com/challenges/iit-m-assignment-2/challenge_rules
In [ ]:

1640

Comments

You must login before you can post a comment.

Execute