Blocked Unlock Pickup#
Action Space |
|
Observation Space |
|
Reward Range |
|
Creation |
|
Description#
The agent has to pick up a box which is placed in another room, behind a locked door. The door is also blocked by a ball which the agent has to move before it can unlock the door. Hence, the agent has to learn to move the ball, pick up the key, open the door and pick up the object in the other room. This environment can be solved without relying on language.
Mission Space#
“pick up the {color} {type}”
{color} is the color of the box. Can be “red”, “green”, “blue”, “purple”, “yellow” or “grey”.
{type} is the type of the object. Can be “box” or “key”.
Action Space#
Num |
Name |
Action |
---|---|---|
0 |
left |
Turn left |
1 |
right |
Turn right |
2 |
forward |
Move forward |
3 |
pickup |
Pick up an object |
4 |
drop |
Unused |
5 |
toggle |
Unused |
6 |
done |
Unused |
Observation Encoding#
Each tile is encoded as a 3 dimensional tuple:
(OBJECT_IDX, COLOR_IDX, STATE)
OBJECT_TO_IDX
andCOLOR_TO_IDX
mapping can be found in minigrid/core/constants.pySTATE
refers to the door state with 0=open, 1=closed and 2=locked
Rewards#
A reward of ‘1 - 0.9 * (step_count / max_steps)’ is given for success, and ‘0’ for failure.
Termination#
The episode ends if any one of the following conditions is met:
The agent picks up the correct box.
Timeout (see
max_steps
).
Registered Configurations#
MiniGrid-BlockedUnlockPickup-v0