Training iteration time

[aoqianz]

I'm wondering what is the normal training time for each iteration on a RTX4090? I'm training 4096 environments in parallel and each iteration takes more than 20 seconds. The paper states the training can reach 2000 iterations in just 1 hour.

[LeoSource]

I have the same problem, it is too slow.
Is it normal or abnormal?

[RX-105]

Me too. Every iteration cost ~60s on an A800 with vanilla config. I even don't know what's wrong.

[LeoSource]

the problem is the value "num_steps_per_env", change it to 24 will be OK.