Distilling LLMs with Compact, Powerful Models for Everyone: Introducing DistillKit by Arcee AI
First, Arcee AI revolutionized Small Language Models (SLMs) with Model Merging and the open-source repo MergeKit. Today we bring you another leap forward in the creation and distribution of SLMs with an open soure tool we're calling DistillKit.
