StepFun’s Step 5 Preview ranks among top three open-source models globally
Step 5 Preview uses a sparse mixture-of-experts architecture with 600 billion total parameters but activates only 27 billion at a time.
Step 5 Preview uses a sparse mixture-of-experts architecture with 600 billion total parameters but activates only 27 billion at a time.