A new communication-collective system, OptiReduce, speeds up AI and machine learning training across multiple cloud servers by setting time boundaries rather than waiting for every server to catch up, according to a study led by a University of Michigan researcher.
Perfect is the enemy of good for distributed deep learning in the cloud
