Microsoft AI finishes pre-training MAI-Base-2, a 2.8-trillion-parameter mixture-of-experts model

It has 80 billion active parameters and trained on 16,000 GB200 GPUs for 38 days; post-training continues and no release date is set.

It has 80 billion active parameters and trained on 16,000 GB200 GPUs for 38 days; post-training continues and no release date is set.