DeepSeek announces open source optimization parallel strategy
Editor
2 hours ago 6,205
Share to:
Golden Finance reported that Deepseek announced an open source optimization parallel strategy on the fourth day of the open source week, including DualPipe—including a bidirectional pipeline parallel algorithm for computing-communication overlap in V3/R1 training; EPLB—a expert parallel load balancer for V3/R1; and analyzing computing-communication overlap in V3/R1. (Jin Shi)