Profiled DDL RAMP.zip (1.27 GB)
Download file

Profiled DDL RAMP

Download (1.27 GB)
dataset
posted on 29.04.2022, 09:56 by Alessandro OttinoAlessandro Ottino

Collection of profiled models  used to estimate the disrtibuted training time for different Transformer Encoder models partiotioned using Megatron partitioning strategy, for different target losses

History