moolib.EnvStepper

class moolib.EnvStepper

A helper class for EnvPool.

This class is used by EnvPool implementation to step through its batches of environments via RPC.

__init__(*args, **kwargs)

Methods

__init__

step

Step through a batch of envs.
step()

Step through a batch of envs.

Parameters

  • batch_index (int) – index of the batch of envs are we stepping.

  • action (torch.Tensor) – actions for each of the envs [BATCH_SIZE]