astra-sim/astra-sim
ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale
What it solves
ASTRA-sim addresses the complexity of designing and deploying next-generation distributed AI systems by providing a way to simulate the entire software and hardware stack. This allows developers and architects to test different configurations of workload scheduling, communication algorithms, and hardware architectures without needing the physical hardware.
How it works
It functions as a distributed AI system simulator that models compute, memory, and network hardware alongside software layers. It uses a suite of APIs that allow users to plug in external open or proprietary components to model specific parts of the system. The simulator accepts MLCommons Chakra Execution Traces as inputs for the workload layer.
Who it’s for
It is designed for researchers and engineers working on the design and deployment of large-scale distributed AI systems.
Highlights
- End-to-end multi-fidelity simulation of AI systems.
- Models the full stack from workload scheduling to hardware architectures.
- Plug-and-play API support for external components.
- Integration with MLCommons Chakra Execution Traces.
Related
- Project
- Project
- Project
- Project