DeepMind working on distributed training of large AI models
DeepMind's approach with DiLoCo has been to relax the need for co-location of training clusters by creating distributed ...