Model Merging

News & developments on Model Merging.

Arcee-SuperNova: Training Pipeline and Model Composition

Arcee-SuperNova: Training Pipeline and Model Composition

We trained Arcee SuperNova-70B and Arcee SuperNova-8B to be a generally intelligent Llama-3.1-405B derivatives using intelligent distillation, novel post-training, and model merging techniques.

Use MergeKit to Extract LoRA Adapters from any Fine-Tuned Model

Use MergeKit to Extract LoRA Adapters from any Fine-Tuned Model

We show you how to use Arcee's MergeKit to extract LoRA adapters from fine-tuned models, then leverage the Hugging Face Hub to create a library of general and task-specific LoRA adapters.

Evolutionary Model Merging For All

Evolutionary Model Merging For All

We've been focused on developing this groundbreaking technique for the community, and we're now excited to announce the launch of this state-of-the-art functionality in MergeKit.

How to Merge Llama3 Using MergeKit

How to Merge Llama3 Using MergeKit

... And what do we do at Arcee when an exciting new model drops? We MERGE IT on MergeKit! We walk you through the process and share the initial results.

Arcee/Mergekit launch Model Merging Hackathon

Arcee/Mergekit launch Model Merging Hackathon

Arcee & MergeKit advance model merging innovations with launch of MergeKit Hackathon, co-sponsored by AWS. Submit your model merging research, experiments, and results for the chance to win cash prizes!

Case Study: Innovating Domain Adaptation through Continual Pre-Training and Model Merging

Case Study: Innovating Domain Adaptation through Continual Pre-Training and Model Merging

We show how Arcee uses the most innovative Continual Pre-Training and Model Merging techniques to deliver high-quality domain-specific language models at a fraction of the cost of our competitors–using Medical and Patent data.

March is Merge Madness

March is Merge Madness

To celebrate Arcee’s recent merger with mergekit, we’re bringing you a month of resources and knowledge on model merging.