News from Arcee.ai, the industry leader in Small Language Models (SLMs)

Train, Merge, & Domain-Adapt Llama-3.1 with Arcee AI

Train, Merge, & Domain-Adapt Llama-3.1 with Arcee AI

Get Llama-3.1 but better – customize the OS model for all your needs, using Arcee AI's training, merging, and adaptation techniques and tools. Our team created this guide to get you started.

Partner Spotlight: Arcee AI & MongoDB

Partner Spotlight: Arcee AI & MongoDB

Joint customers use MongoDB & Arcee AI to take data from JSON files to world-class custom language models in just a few clicks.

Arcee-AI Releases Two Open Datasets

Arcee-AI Releases Two Open Datasets

Today, we have made two important datasets publicly available: 1. Agent Data: This dataset was instrumental in training Arcee-Agent. It contains Salesforce-xlam, agent-flan, and a custom version of Glaive-FC2 with 20k extended samples that call for the model to do tool use sequentially within the same response, along with Magpie-Pro

Introducing Arcee-Nova

Introducing Arcee-Nova

What a week here at Arcee AI. On the heels of Arcee-Scribe yesterday, today we bring you Arcee-Nova – our highest-performing open source model... Evaluated on the same stack as the OpenLLM Leaderboard 2.0, making it the top-performing open source model tested on that stack. Its performance approaches that of

Our Series A, Julien Simon Joins the Team, & Arcee Cloud Goes Live

Our Series A, Julien Simon Joins the Team, & Arcee Cloud Goes Live

Less than a year after emerging from stealth, Arcee AI has hit the headlines – announcing a major Series A, the arrival of Chief Evangelist Julien Simon, and the launch of a new cloud platform.

Introducing Arcee-Scribe: Your Creative Writing Partner

Introducing Arcee-Scribe: Your Creative Writing Partner

Need a guide or just some inspiration for your writing tasks – especially those that require a dose of creativity? Get your artistic juices flowing with the latest model by Arcee AI.

How Do I Prep my Data to Train an LLM?

How Do I Prep my Data to Train an LLM?

So you want to train a custom language model, and you do have the requisite large set of text data. But how do you know that the data is *really actually ready* for model training? Our researchers here at Arcee AI tell you what to look out for.

Optimizing LLM Training with Spectrum

Optimizing LLM Training with Spectrum

Here at Arcee AI, we're the pioneers of training performant and efficient LLMs with Model Merging... And now we bring you *yet another* cutting-edge technique that also dramatically optimizes your training and improves your models.

Introducing Arcee Agent: A Specialized 7B Language Model for Function Calling and Tool Use

Introducing Arcee Agent: A Specialized 7B Language Model for Function Calling and Tool Use

Arcee Agent is yet another Arcee model punching above its weight: it's just 7B (initialized from Qwen2-7B) and outranks much larger models. Try it out for function calling and tool use!

The Hidden Challenges of Domain-Adapting LLMs

The Hidden Challenges of Domain-Adapting LLMs

Adapting an LLM to a specific domain might sound straightforward, but it in fact opens a Pandora's box of challenges. Our research team explains the shortfalls of some of the most common techniques.

Arcee Spark: A Compact & Efficient 7B Parameter Language Model

Arcee Spark: A Compact & Efficient 7B Parameter Language Model

Looking for proof that Small is the new Big when it comes to language models? Look no further than the model we've just dropped here at Arcee AI: you get top-notch results with just 7B parameters.

Introducing the Ultimate SEC LLM: Revolutionizing Financial Insights

Insights Featured

Introducing the Ultimate SEC LLM: Revolutionizing Financial Insights

We built Llama-3-SEC upon the powerful Meta-Llama-3-70B-Instruct model, with the goal of providing unparalleled insights and analysis capabilities for financial professionals, investors, researchers, and anyone working with SEC filings and related financial data.

Arcee Cloud: The LLM Solution for Everyone

Arcee Cloud: The LLM Solution for Everyone

We’re thrilled to announce that we’re launching Arcee Cloud, a fully hosted SaaS offering that makes world-class LLM production accessible to all – in an easy-to-use platform for Training, Merging, and Deploying custom language models.

Use MergeKit to Extract LoRA Adapters from any Fine-Tuned Model

Use MergeKit to Extract LoRA Adapters from any Fine-Tuned Model

We show you how to use Arcee's MergeKit to extract LoRA adapters from fine-tuned models, then leverage the Hugging Face Hub to create a library of general and task-specific LoRA adapters.

Evolutionary Model Merging For All

Insights Featured

Evolutionary Model Merging For All

We've been focused on developing this groundbreaking technique for the community, and we're now excited to announce the launch of this state-of-the-art functionality in MergeKit.

Why Methods Like QLoRA Fall Short in Domain Knowledge Injection

Why Methods Like QLoRA Fall Short in Domain Knowledge Injection

Arcee's research shows that the Standard Continual Pre-Training (CPT) approach performs better than QLORA-based CPT.

How to Merge Llama3 Using MergeKit

How to Merge Llama3 Using MergeKit

... And what do we do at Arcee when an exciting new model drops? We MERGE IT on MergeKit! We walk you through the process and share the initial results.

Arcee/Mergekit launch Model Merging Hackathon

Arcee/Mergekit launch Model Merging Hackathon

Arcee & MergeKit advance model merging innovations with launch of MergeKit Hackathon, co-sponsored by AWS. Submit your model merging research, experiments, and results for the chance to win cash prizes!

Arcee releases new repo of LLMOps tools

Arcee releases new repo of LLMOps tools

Check out our new Model-Tools repository on Github: a collection of custom tools, scripts and more to boost your LLMOps capabilities.

Arcee launches The Small Language Show, first episode goes deep on Model Merging

Arcee launches The Small Language Show, first episode goes deep on Model Merging

It’s the place to be for anyone who wants to learn about the next big thing in LLMs: The SMALL Language Show, live-streaming biweekly and bringing you chats with the world's top experts in LLM and SLM research.

Case Study: Innovating Domain Adaptation through Continual Pre-Training and Model Merging

Insights Featured

Case Study: Innovating Domain Adaptation through Continual Pre-Training and Model Merging

We show how Arcee uses the most innovative Continual Pre-Training and Model Merging techniques to deliver high-quality domain-specific language models at a fraction of the cost of our competitors–using Medical and Patent data.

What are the top 5 industries ripe for SLM adoption?

What are the top 5 industries ripe for SLM adoption?

LLMs are so 2023, and SLMs (Small Language Models) are the future of enterprise GenAI. Our Solutions Engineering Lead Tyler Odenthal wrote about how domain-adapted SLMs are being used across diverse sectors ranging from law and healthcare to education and customer service.

Arcee celebrates seed round & merger with mergekit

Arcee celebrates seed round & merger with mergekit

The first quarter of 2024 isn’t over yet, but we’ve already had epic developments at Arcee – with TechCrunch announcing our seed round, and our decision to merge with mergekit.

Arcee + mergekit: our commitment to open source

Arcee + mergekit: our commitment to open source

On Day 3 of March Merge Madness we’re striking a bit of a serious note, with a discussion about our very serious commitment to the open source community.

How model merging fits into Arcee's SLM system

How model merging fits into Arcee's SLM system

Why the state-of-the-art technique works so well for our Small Language Model (SLM) system and domain-specific tasks