Skip to content

Commit fbd0a55

Browse files
KMFODAJorritvanGils
authored andcommitted
Remove 8 bit compression
1 parent a00faae commit fbd0a55

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

distributed_training/utils/state_loader.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -718,7 +718,7 @@ def load_model_optimizer_gradient_averager(
718718
dht=self.dht,
719719
main_parameters=main_parameters,
720720
offloaded_optimizer=self.outer_optimizer,
721-
compression=hivemind.Quantile8BitQuantization(),
721+
compression=hivemind.NoCompression(),
722722
prefix=f"{self.config.neuron.run_id}_grad_averager",
723723
min_group_size=self.config.neuron.min_group_size,
724724
min_matchmaking_time=30.0,

0 commit comments

Comments
 (0)