Profiled DDL RAMP.zip (1.27 GB)
Download file

Profiled DDL RAMP

Download (1.27 GB)
dataset
posted on 29.04.2022, 09:56 authored by Alessandro OttinoAlessandro Ottino

Collection of profiled models  used to estimate the disrtibuted training time for different Transformer Encoder models partiotioned using Megatron partitioning strategy, for different target losses

History