Soofi: Complete training code for an open-source foundation model
SoofipretrainingmidtrainingNemotron 3 NanoAImachine learningdeep learningmodel trainingmodel architecture.
Author: mnewme
Date: 7/15/2026
Article Summary:
This repository contains scripts, documentation, and code for the pre- and midtraining activities of the Soofi Project, a 30B model based on Nvidia's Nemotron 3 Nano architecture.