Mark McQuade - Arcee Blog

Go to arcee.ai

Mark McQuade

How to Merge Llama3 Using MergeKit

How to Merge Llama3 Using MergeKit

... And what do we do at Arcee when an exciting new model drops? We MERGE IT on MergeKit! We walk you through the process and share the initial results.

Arcee/Mergekit launch Model Merging Hackathon

Arcee/Mergekit launch Model Merging Hackathon

Arcee & MergeKit advance model merging innovations with launch of MergeKit Hackathon, co-sponsored by AWS. Submit your model merging research, experiments, and results for the chance to win cash prizes!

Case Study: Innovating Domain Adaptation through Continual Pre-Training and Model Merging

Insights Featured

Case Study: Innovating Domain Adaptation through Continual Pre-Training and Model Merging

We show how Arcee uses the most innovative Continual Pre-Training and Model Merging techniques to deliver high-quality domain-specific language models at a fraction of the cost of our competitors–using Medical and Patent data.

Introducing Arcee’s SLM Adaptation System

Introducing Arcee’s SLM Adaptation System

At Arcee, we believe in a world of smaller, specialized models that we call SLM’s. The “S” stands for smaller, specialized, scalable, and secure. These models are grounded on your data, run entirely in your own environment, and are infinitely scalable for all your use cases. We feel these

Arcee and mergekit unite

Arcee and mergekit unite

Several months ago, I stumbled upon an innovative technique in the world of language model training known as Model Merging. This SOTA approach involves the fusion of two or more LLMs into a singular, cohesive model, presenting a novel and experimental method for creating sophisticated models at a fraction of

Unveiling DALM: Revolutionizing Enterprises with Domain Adapted Language Model Systems

Unveiling DALM: Revolutionizing Enterprises with Domain Adapted Language Model Systems

In the rapidly evolving landscape of Generative AI, the quest for more refined and contextually aware language models has led to our development of the Domain Adapted Language Model System (DALM). This innovation promises to reshape how enterprises harness the power of language models tailored to their specific domains. In