Distributed dynamic programming for discrete-time stochastic control, and idempotent algorithms