Snowflake: Arctic Instruct

snowflake/snowflake-arctic-instruct

Created Apr 30, 20244,096 context

Arctic is a dense-MoE Hybrid transformer architecture pre-trained from scratch by the Snowflake AI Research Team. Arctic combines a 10B dense transformer model with a residual 128x3.66B MoE MLP resulting in 480B total and 17B active parameters chosen using a top-2 gating.

To read more about this model's release, click here.

    Snowflake: Arctic Instruct – Run with an API | OpenRouter