Arcee.ai @arcee_ai profile

Evolutionary Model Merging For All

5

31

148

Arcee.ai

@arcee_ai

4 months

We have huge news today for Model Mergers... We're now excited to announce the launch of the state-of-the-art functionality of Evolutionary Model Merging in MergeKit! #nlp #ai #LLM #LLMs

We've been focused on developing this groundbreaking technique for the community, and we're now excited to announce the launch of this state-of-the-art functionality in MergeKit.

Introducing the Ultimate SEC LLM: Revolutionizing Financial Insights

1

25

117

Arcee.ai

@arcee_ai

16 days

Arcee is dropping two new datasets today: 1. The Tome: A 1.75M sample dataset filtered for training strong generalist models, used for Spark & Nova. 2. Agent Data: Key for Arcee-Agent, includes Salesforce-xlam, agent-flan, Glaive-FC2 (20k samples), and Magpie-Pro. Links below.

4

63

Arcee.ai

@arcee_ai

4 months

In collab /w @huggingface , Arcee is thrilled to release our MergeKit Hugging Face Space. 🙌 You now can perform model merges w/ MergeKit in an easy-to use-UI, & save models right into your Hugging Face hub. Try it out here: (1/2) #nlp #llm #llms

1

14

47

Arcee.ai

@arcee_ai

2 months

Arcee AI is excited to launch 💡Llama-3-SEC💡 Built on Meta-Llama-3-70B-Instruct w/ goal of providing unparalleled insights & analysis capabilities for finance pros, investors, researchers, & anyone working w SEC filings & related data. #nlp #LLMs #ai

We built Llama-3-SEC upon the powerful Meta-Llama-3-70B-Instruct model, with the goal of providing unparalleled insights and analysis capabilities for financial professionals, investors, researchers,...

1

7

32

Arcee.ai

@arcee_ai

2 months

New Model Release 🔥 Introducing Hermes 2 Theta 70B! This model is smarter, more creative, and more capable than ever before. It outperforms Llama-3 Instruct 70B on various benchmarks. A proud collaboration with @Teknium1 , @theemozilla , @karan4d , and @NousResearch

1

4

28

Arcee.ai

@arcee_ai

20 days

🆕ARCEE AI MODEL ALERT🆕 We’ve just dropped Arcee-Nova: 🤗Evaluated on the OpenLLM Leaderboard 2.0 stack 🏆Top-performing OS model on this stack 📈Approaches GPT-4 (May 2023) performance levels, marking a significant milestone. Details here: #LLMs

Introducing Arcee-Nova

What a week here at Arcee AI. On the heels of Arcee-Scribe yesterday, today we bring you Arcee-Nova – our highest-performing open source model... Evaluated on the same stack as the OpenLLM Leaderbo...

3

6

24

Arcee.ai

@arcee_ai

21 days

🆕ARCEE AI MODEL ALERT🆕 While working on Spark v2, we discovered a training checkpoint of InternLM-2.5 that we adored. Though it doesn't fully meet our expectations for a Spark model, its language skills are exceptional, particularly in creative writing... 🧵 (1/4)

3

4

21

Arcee.ai

@arcee_ai

9 days

🌟 Nothing better than getting stellar reviews of our model releases! 🌑 𝗔𝗿𝗰𝗲𝗲-𝗡𝗼𝘃𝗮 is our highest-performing #opensource model... 🧠 We created it by merging Qwen2-72B-Instruct w/ a custom model tuned on a generalist dataset mixture... (1/4) #LLM #GenAI #NLP

2

4

18

Arcee.ai

@arcee_ai

1 month

Haven’t had a chance to read up on the Spectrum method for efficiently training #LLMs by targeting specific layer modules? It optimizes resource usage, cutting training time & costs IN HALF. Check out the paper here () or learn the basics in our video ⬇️

0

5

17

Arcee.ai

@arcee_ai

22 days

Thanks to @VentureBeat for covering this huge milestone for Arcee AI… ✨Less than a year after emerging from stealth, we’ve signed a $24 million Series A led by @emergencecap ✨ 💗Proud to celebrate w/ our partners, our team, & our customers 💗 Link to article in replies ⬇️

4

15

Arcee.ai

@arcee_ai

1 month

🕵‍Wondering what you can do with our new 7B #LLM , Arcee Agent?‍ It may be just a 7B but it's an invaluable asset for automating multi-step business tasks and processes, across industries. Check out the demo in this video by our @LucasAtkins7 ⬇️ (1/2) #nlp #GenAI #LLMs

1

3

13

Arcee.ai

@arcee_ai

3 months

Small Language Model Show Ep. 5: Model Merging & Evolutionary Model Merging

Small Language Model Show Ep. 5: Model Merging & Evolutionary Model Merging

1

3

12

Arcee.ai

@arcee_ai

1 month

You know Model Merging is catching on when @GoogleDeepMind cites your paper! Congrats to our @Chargoddard , @Malikeh5 , @mmcquade_ai_u & rest of our research team RE the citation of your 🌟Mergekit paper🌟 Read it here:

Arcee's MergeKit: A Toolkit for Merging Large Language Models

The rapid expansion of the open-source language model landscape presents an opportunity to merge the competencies of these model checkpoints by combining their parameters. Advances in transfer...

arxiv.org

Alexandre Ramé

@ramealexandre

1 month

Introducing Weight Averaged Rewarded Policies (WARP), Google DeepMind's latest RLHF alignment method using the magic of model merging. By scaling alignment like pre-training was scaled, WARP learns sota Gemma LLM surpassing previous releases. A 🧵below.

6

36

231

0

1

12

Arcee.ai

@arcee_ai

20 days

ICYMI, we've had 👀 a few 👀 developments this week. TL;DR: 🌟 We announced our $24 million Series A, led by @emergencecap 🖊️ We signed @julsimon as our Chief Evangelist ⛅ Our hosted SaaS, Arcee Cloud, went LIVE. Recap here ⬇

Our Series A, Julien Simon Joins the Team, & Arcee Cloud Goes Live

Less than a year after emerging from stealth, Arcee AI has hit the headlines – announcing a major Series A, the arrival of Chief Evangelist Julien Simon, and the launch of a new cloud platform.

Arcee's MergeKit: A Toolkit for Merging Large Language Models

1

4

12

Arcee.ai

@arcee_ai

14 days

✨Everything you want to know about @arcee_ai 's groundbreaking #LLM & #SLM training technique, Spectrum 🙌Brought to you by @AIMakerspace 's @GregOnLock & @llm_wizard 🎙️Featuring @LucasAtkins7 & @FernandoNetoAi RSVP ⬇️ #NLP #GenAI

1

4

11

Arcee.ai

@arcee_ai

21 days

Wishing a huge welcome to @julsimon who has joined us as Chief Evangelist! From AWS to Hugging Face and now to @arcee_ai Julien has led the way on #AI development... & now shares our conviction that #SLM -led #GenAI is the future👏👏 Honored to have you on this journey!!! 🚀🚀

1

5

11

Arcee.ai

@arcee_ai

5 months

Ready to learn more about Model Merging? For Day 15 we bring you the paper we just published: "Arcee's MergeKit: A Toolkit for Merging Large Language Models" Hit us up here with your questions on all things MergeKit! #nlp #ai #llm #llms

The rapid expansion of the open-source language model landscape presents an opportunity to merge the competencies of these model checkpoints by combining their parameters. Advances in transfer...

arxiv.org

0

5

10

Arcee.ai

@arcee_ai

2 months

Coming up: our 🎉Bonus Edition 🎉 of the Small Language Model (SLM) show, w/ the winner of our MODEL MERGING Hackathon @maximelabonne talking about his winning merge. Hosts @Malikeh5 & @ @mmcquade_ai_u will also chat RE our EPIC model release Llama-3-SEC

SLM Show Special Edition: Model Merging Hackathon Winners, & Llama-3-SEC | LinkedIn

www.linkedin.com

0

2

11

Arcee.ai

@arcee_ai

2 months

Haven't yet had a chance to check out our epic model release, Llama-3-SEC? Our @LucasAtkins7 walks you through his queries about this week's hottest stock (NVIDIA of course) - check it out here: #nlp #GenAI #LLMs #LLM

0

4

10

Arcee.ai

@arcee_ai

5 months

We're thrilled to welcome @maximelabonne to the first episode of The Small Language Model (SLM) Show... He'll talk about his extensive experimenting w/ MODEL MERGING, w/ MergeKit Founder @chargoddard #nlp #llm #ai

0

2

9

Arcee.ai

@arcee_ai

1 month

Here at Arcee AI, every day we’re making the world more aware of the power of Small Language Models (SLMs), & today we’re dropping the 🦾highest-scoring model ever 🦾in the 7B-15B range: 🎇Arcee Spark🎇, which outperforms Mixtral-8x7B & Llama-3-8B-Instruct! 🧵 (1/3)

1

2

9

Arcee.ai

@arcee_ai

5 months

The Small Language Model (SLM) Show, Episode 1: All About Model Merging

The Small Language Model (SLM) Show, Episode 1: All About Model Merging

0

1

10

Arcee.ai

@arcee_ai

1 month

Another day, another amazing stat RE our Arcee Spark model. W/ an EQ-Bench score of 71.4, Arcee Spark outranks: • Phi-3-medium from Microsoft (double its size), • Claude Sonnet 3, & is almost even w/ miquella120b 👏 Find it here: #LLMs #GenAI #NLP

1

10

Arcee.ai

@arcee_ai

3 months

Coming up: the latest on Model Merging, including our Evolutionary Model Merging release–w/ the author @chargoddard talking to the hosts from @AIMakerspace , @llmwizard & Dr. Greg Loughane. Happening @ 10amPT / 1pm ET, sign up here: #nlp #ai #LLM #LLMs

Merging pre-trained LLMs with mergekit · Luma

One of the eMERGing techniques in the Large Language Model (LLM) space is model merging. The big idea is to combine two or more LLMs into a single model. This…

lu.ma

0

2

9

Arcee.ai

@arcee_ai

14 days

🤔 What should you be doing with #llama31 , the latest and greatest open source #LLM ? 🧠 You should be MERGING IT. 👩‍🏫 You should be TRAINING IT. 💁‍♂️ You should be adapting it to your domain & use case. Our Jacob Solawetz wrote you a guide: #NLP #GenAI

Train, Merge, & Domain-Adapt Llama-3.1 with Arcee AI

Get Llama-3.1 but better – customize the OS model for all your needs, using Arcee AI's training, merging, and adaptation techniques and tools. Our team created this guide to get you started.

mergekit: Llama 3 Fine-Tuning and Merging

0

1

9

Arcee.ai

@arcee_ai

3 months

📣ICYMI – Check out this terrific chat about the power of Model Merging, featuring Arcee's @chargoddard (the founder of MergeKit) & hosted by the talented folks over at @AIMakerspace : #nlp #genai #LLMs

This event unveils the secret behind combining multiple Large Language Models into a powerhouse single model, a technique that's revolutionizing performance....

How Do I Prep my Data to Train an LLM?

0

3

9

Arcee.ai

@arcee_ai

3 months

Arcee's @Malikeh5 & @chargoddard repping all things Model Merging & SLMs at @_odsc 👏

0

3

9

Arcee.ai

@arcee_ai

29 days

🤔 How do you know your data is ready to train a language model? ✅ Practical insights from our researchers here at Arcee AI: @shahrzad_sayeh , @Malikeh5 , @GShamane #LLM #GenAI #nlp

So you want to train a custom language model, and you do have the requisite large set of text data. But how do you know that the data is *really actually ready* for model training? Our researchers...

Spectrum: Targeted Training on Signal to Noise Ratio

0

3

7

Arcee.ai

@arcee_ai

5 months

ICYMI: Episode 1 of The Small Language Model (SLM) Show, co-hosted by @mmcquade_ai_u & @MaryMacCarthy , featuring two of the premier open source experts on MODEL MERGING, @chargoddard & @maximelabonne #nlp #ai #llm #llms

Arcee.ai

@arcee_ai

5 months

The Small Language Model (SLM) Show, Episode 1: All About Model Merging

0

1

10

0

1

8

Arcee.ai

@arcee_ai

8 days

👏 Congrats to Arcee-Nova for its high ranking on the Open #Arabic #LLM Leaderboard on @huggingface . 🏆 It's 𝗙𝗢𝗨𝗥𝗧𝗛 𝗼𝘃𝗲𝗿𝗮𝗹𝗹... 🥇 And 𝗙𝗜𝗥𝗦𝗧 𝗶𝗻 𝘁𝗵𝗿𝗲𝗲 𝗯𝗲𝗻𝗰𝗵𝗺𝗮𝗿𝗸𝘀: ACVA, MMLU, and EXAMS. #GenAI #NLP

0

3

9

Arcee.ai

@arcee_ai

2 months

Congrats 2 Arcee AI's @LucasAtkins7 & @FernandoNetoAI as co-authors on this paper introducing a method to accelerate #LLM training by selectively targeting layer modules based on their signal-to-noise ratio, freezing the rest. Drop questions for them here!

Efficiently post-training large language models remains a challenging task due to the vast computational resources required. We present Spectrum, a method that accelerates LLM training by...

arxiv.org

0

2

8

Arcee.ai

@arcee_ai

4 months

Model Merging onstage at MIT today for the Imagination in Action: Forging the Future of Business with AI Summit. Arcee's @chargoddard talking all things MergeKit! Video recording of the talk coming soon here🚀 #ai #nlp #LLM #LLMs

1

2

8

Arcee.ai

@arcee_ai

8 months

Build domain adaptive models and use them with @LangChainAI to have complete control over your applications Here's a quick cookbook to get started:

Langchain+Arcee: build domain models with greater flexibility

Combining Arcee’s generators and retrievers with Langchain allows you to build almost any AI application you wish, from using retrievers to fully autonomous systems using chains and agents.

1

5

8

Arcee.ai

@arcee_ai

2 months

SLM Show Special Edition: Model Merging Hackathon Winners, & SEC Model Release

SLM Show Special Edition: Model Merging Hackathon Winners, & SEC Model Release

0

3

8

Arcee.ai

@arcee_ai

15 days

We're hiring

1

3

7

Arcee.ai

@arcee_ai

23 days

Great example of our model 🕵️‍♂️Arcee Agent🕵️‍♂️in action here - thanks @llama_index 👏

LlamaIndex 🦙

@llama_index

23 days

Deploy llama-agents running entirely self-hosted agents using @arcee_ai , @MistralAI and @ollama ! In this video, @1littlecoder walks you through ➡️ Setting up llama-agents ➡️ Getting local models running with @ollama ➡️ Building tools and running them with @arcee_ai

2

19

87

0

1

7

Arcee.ai

@arcee_ai

22 days

Love Santiago's @svpino 's breakdown of the power of Spectrum and Model Merging to create incredibly powerful SLMs🦾

Santiago

@svpino

22 days

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a

35

344

2K

0

1

7

Arcee.ai

@arcee_ai

21 days

... in MergeKit, though the current version of transformers messes with the InternLM tokenizer when using save.pretrained. It took quite a while to get a working model. Proceed with caution! (4/4) #NLP #GenAI

arcee-ai/Arcee-Scribe · Hugging Face

What is an SLM (Small Language Model)?

0

7

Arcee.ai

@arcee_ai

5 months

Starting to really understand the shortcomings of LLMs?It's time to check out SLMs–our Small Language Model system that's the answer for enterprises looking for bespoke #ai trained on THEIR data. Big results at a great price 🦾 #nlp #ai #LLM #LLMs

The world of LLMs (Large Language Models) has cooked up a storm in recent years, with the rise of OpenAI’s GPT and the increasing proliferation of open source language models. Much excitement...

Optimizing LLM Training with Spectrum

1

3

Arcee.ai

@arcee_ai

3 months

It's been just a couple of weeks since we launched the MergeKit GUI (), & we're already closing in on 7k merges! BTW don't forget to submit your merges for our Model Merging Hackathon-you have until May 6! Details here: #nlp #LLM

0

6

Arcee.ai

@arcee_ai

28 days

Ready to learn more about the technique called Spectrum for optimizing #LLM training? Spectrum: ⏲ Reduces training time 📝 Improves memory efficiency 🧠 Minimizes catastrophic forgetting. More in this article ⬇️ by our @LucasAtkins7 #nlp #GenAI

Here at Arcee AI, we're the pioneers of training performant and efficient LLMs with Model Merging... And now we bring you *yet another* cutting-edge technique that also dramatically optimizes your...

The Small Language Model Show

0

1

6

Arcee.ai

@arcee_ai

4 months

Greet week of collab between @arcee_ai & @huggingface : along w/ the release of 2 Arcee / MergeKit Hugging Face Spaces (one of which is a Featured Space: ), our founders & other team members got to hang with Hugging Face CEO @ClementDelangue 🤗 in Miami 🌴

0

2

6

Arcee.ai

@arcee_ai

23 days

Here at Arcee AI, that's exactly what our end-to-end platform for training and deploying CUSTOM LANGUAGE MODELS gives our customers. We're dropping the ☁️ version, Arcee Cloud, TOMORROW! Check out the DEMO-linked in the comments! (2/2) #NLP #AI #LLMs

1

0

6

Arcee.ai

@arcee_ai

2 months

BIG news - Arcee AI’s Small Language Model show is now available on your favorite podcast platform. Subscribe on Apple Podcasts here: And on Spotify here.

Podcast · [object Object] · It’s the place to be for anyone who wants to learn about the next big thing in LLMs: The SMALL Language Show, live-streaming biweekly and bringing you chats with the...

open.spotify.com

1

6

Arcee.ai

@arcee_ai

1 month

Arcee AI's @LucasAtkins7 on Arcee Agent & the other models we've recently released, live now👋

Lucas Atkins

@LucasAtkins7

1 month

Talking @arcee_ai agent.

0

6

0

6

Arcee.ai

@arcee_ai

1 month

Check out @LucasAtkins7 's look at the model we dropped today: the 7B Arcee Spark: 🌟 it's the highest-scoring model by far in the 7B-15B range 🌟 it gets jokes, and can explain jokes better than some of us 😆 #nlp #LLM #GenAi

Lucas Atkins

@LucasAtkins7

1 month

A demo of arcee-spark, using it alongside Florence from @MSFTResearch and Whisper to analyze what makes an ad "ironic."

2

3

25

0

1

6

Arcee.ai

@arcee_ai

2 months

Weekend reminder to MODEL MERGERS - get 💸 for your work by entering the @NeurIPSConf model merging competition - details below. @arcee_ai is proud to be a co-sponsor as we help bring Model Merging to the world 🦾🌎

Leshem Choshen 🤖🤗 @ICML wanna talk?

@LChoshen

2 months

🚨 Model Merging competition @NeurIPSConf !🚀 Can you revolutionize model selection and merging?Let's create the best LLMs!🧠✨ 💻Come for science 💰Stay for $8K 💬Discord: 🔗Sign up: Sponsors: @huggingface @SakanaAILabs @arcee_ai

4

46

183

0

2

6

Arcee.ai

@arcee_ai

7 days

With the launch of our Small Language Model (SLM) training & merging platform's in-browser version, Arcee Cloud, we're seeing a spike in people getting started w/ Model Merging. Here are 3 great resources to guide you: 1) Our docs, of course: ... (1/2)

Arcee Docs

Concept and API docs for the Arcee language model training and merging platform.

docs.arcee.ai

1

8

Arcee.ai

@arcee_ai

28 days

More great work by @NousResearch with our @chargoddard 👏

Nous Research

@NousResearch

2 months

Introducing Hermes 2 Theta 70B! Hermes 2 Theta is smarter, more creative, and capable of more then ever before. It takes a strong lead over Llama-3 Instruct 70B across a wide variety of benchmarks, and is a continuation of our collaboration with @chargoddard and @arcee_ai .

10

61

333

0

6

Arcee.ai

@arcee_ai

1 month

Maybe we should have called Arcee Spark "Alanis" since it does such a good job of explaining what "ironic" is

Lucas Atkins

@LucasAtkins7

1 month

A demo of arcee-spark, using it alongside Florence from @MSFTResearch and Whisper to analyze what makes an ad "ironic."

2

3

25

0

6

Arcee.ai

@arcee_ai

2 months

is psyched to be a co-sponsor of this MODEL MERGING competition. Details below on how to win cash for getting your merge on 🤑

Arcee AI - Your LLM, Your Data, Your Cloud

Arcee AI empowers organizations to build, own, and merge specialized AI models with our user-friendly end-to-end system. Train and deploy Small Language Models (SLMs) tailored to your data and...

www.arcee.ai

Leshem Choshen 🤖🤗 @ICML wanna talk?

@LChoshen

2 months

🚨 Model Merging competition @NeurIPSConf !🚀 Can you revolutionize model selection and merging?Let's create the best LLMs!🧠✨ 💻Come for science 💰Stay for $8K 💬Discord: 🔗Sign up: Sponsors: @huggingface @SakanaAILabs @arcee_ai

4

46

183

0

1

6

Arcee.ai

@arcee_ai

3 months

Another great Model Merging tip, from MergeKit founder @chargoddard . QUESTION: When to use merging over a Mixture of Experts (MoE) model? ANSWER: I encourage regular merging over frankenMoEs in pretty much all circumstances. They're a really cool hack and there are ... (1/3)

1

5

Arcee.ai

@arcee_ai

1 month

📺VIDEO HERE: (2/2)

Introducing Arcee Agent: A Specialized 7B Language Model for Function...

We are excited to announce the release of Arcee Agent, a cutting-edge 7B parameter language model designed specifically for function calling and tool use. In...

Arcee Cloud: The LLM Solution for Everyone

1

0

6

Arcee.ai

@arcee_ai

1 month

👏Love seeing these download numbers w/ our Arcee Spark 7B model, released just a week ago.👏 It's the highest-scoring model by far in the 7B-15B range, outperforming Mixtral-8x7B and Llama-3-8B-Instruct. Find it here:

0

6

Arcee.ai

@arcee_ai

3 months

We're excited to announce that our solution for training, merging, and deploying domain-specific language models is coming soon in a Hosted SaaS called Arcee Cloud. Get on the waitlist here , & read more here: #ai #NLP #LLMs

We’re thrilled to announce that we’re launching Arcee Cloud, a fully hosted SaaS offering that makes world-class LLM production accessible to all – in an easy-to-use platform for Training, Merging,...

The SLM Show Episode 4: All Things Hugging Face Hub w/ Jeff Boudier

0

2

6

Arcee.ai

@arcee_ai

1 month

💃Merging on the Move 💃Won't be long now before most model releases are Merges

Maxime Labonne

@maximelabonne

1 month

Gemma 2 is a merge confirmed 🥲

4

7

60

1

0

6

Arcee.ai

@arcee_ai

21 days

BIG smiles from @JonKrohnLearns , @mmcquade_ai_u & @chargoddard as they talk SMALL Language Models😁😁😁

Jon Krohn 🇺🇦

@JonKrohnLearns

22 days

Today's episode is seriously mind-expanding. In it, Mark ( @mmcquade_ai_u ) and Charles ( @chargoddard ) detail how they're pushing the A.I. frontier through LLM merging, extremely efficient (even CPU-only!) LLM training, and *Small* Language Models. Watch here:

0

2

6

0

5

Arcee.ai

@arcee_ai

27 days

Our team is growing fast here at Arcee AI! We're excited to welcome @shahrzad_sayeh as our new ML Product Engineer🚀🚀🚀 Shahrzad is a major contributor to building out the Arcee platform and is already a prolific blogger for us - here's her latest piece:

0

1

5

Arcee.ai

@arcee_ai

4 months

Talking SLMs, Model Merging, and the future of #GenAI in style 🎉 Team in Miami Beach 🌴 @mmcquade_ai_u @Malikeh5 @MaryMacCarthy #ai #nlp #LLM #LLMs

0

1

5

Arcee.ai

@arcee_ai

3 months

Reminder: coming up tomorrow a chance to ask all your @huggingface Hub questions to @jeffboudier , & your Evolutionary Model Merging questions to @chargoddard . Join The SLM Show hosts @mmcquade_ai_u & @MaryMacCarthy live @ 11am PT / 2pm ET: #LLMs #nlp #ai

For Episode 4 of the SLM (Small Language Model) Show, we're bringing you a chat with Jeff Boudier for the latest on the Hugging Face Hub. Whether you're a ne...

Arcee.ai

@arcee_ai

3 months

In Ep. 4 of The SLM (Small Language Model) Show, we have @jeffboudier w/ the latest from @huggingface Hub. Also, @chargoddard RE the MergeKit GUI & Evolutionary Model Merging. Join us LIVE on YouTube May 1 @ 11pm PT / 2 pm ET. #nlp #ai #LLM #LLMs

0

1

3

0

1

5

Arcee.ai

@arcee_ai

9 days

Learn more about Arcee_Nova and find links to the model in our blog ⬇️ (4/4)

Introducing Arcee-Nova

What a week here at Arcee AI. On the heels of Arcee-Scribe yesterday, today we bring you Arcee-Nova – our highest-performing open source model... Evaluated on the same stack as the OpenLLM Leaderbo...

Why Methods Like QLoRA Fall Short in Domain Knowledge Injection

0

1

5

Arcee.ai

@arcee_ai

4 months

The Small Language Model (SLM) Show is giving you another full episode devoted to the Magic of Model Merging. Join hosts @mmcquade_ai_u & @marymaccarthy , MergeKit founder @chargoddard , & special guest @Maya_Akim next Weds 11am PT/2pm EST: #nlp #LLM #LLMs

0

2

5

Arcee.ai

@arcee_ai

3 months

⏲ The countdown is on for our MODEL MERGING HACKATHON, Co-Sponsored by Arcee and AWS. 💰 You have till 5/13 to submit entries in the following categories, for which we're awarding a total of $9k in cash: 🤔 Best New Merge 🤝 Best Integration with Other Ecosystems... (1/2)

1

0

4

Arcee.ai

@arcee_ai

4 months

Which gets you better results for domain-specific LLMs: QLoRA or standard Continual Pre-Training (CPT)? Arcee's Head of Applied NLP Research, Shamane Siri, PhD, explains why (& when) standard CPT reigns supreme: #nlp #ai #LLMs

Arcee's research shows that the Standard Continual Pre-Training (CPT) approach performs better than QLORA-based CPT.

Extract LoRA adapters from any fine-tuned model, with Arcee's MergeKit

0

2

5

Arcee.ai

@arcee_ai

1 month

Full details, included links to the 🎇Arcee Spark🎇 Model Card and how to access the model, are in our blog: (3/3) #GenAI #nlp #LLM #LLMs

0

1

4

Arcee.ai

@arcee_ai

3 months

Arcee is proud to be on an incredible list of winning partners tonight @MongoDB in #NYC . Huge thanks to @dittycheria & @cloudchhabra for the AI Startup of the Year award🙌 🚀🚀🚀

0

5

Arcee.ai

@arcee_ai

3 months

📣 The latest update to Arcee's MergeKit: you can now use MergeKit to extract LoRA adapters from any fine-tuned model. ⬇ Details here from our Research Engineer Thomas Gautier! #nlp #ai #LLM #LLMs

We show you how to use Arcee's MergeKit to extract LoRA adapters from fine-tuned models, then leverage the Hugging Face Hub to create a library of general and task-specific LoRA adapters.

arcee-ai/The-Tome · Datasets at Hugging Face

0

5

Arcee.ai

@arcee_ai

5 months

...to learn about model merging: ⭐ @maximelabonne ⭐ @altryne ⭐️ @prateeky2806 ⭐ @wenqi_glantz ⭐ @erhartford ⭐ @vanstriendaniel ⭐ And last but not least, our own Charles Goddard, the creator of mergekit (on LinkedIn ). (2/2) #nlp #LLM #LLMs #ai

0

1

5

Arcee.ai

@arcee_ai

23 days

What companies want RE #GenAI ... 📈 Find the best model to start from 🖱️ Easily adapt it to their domain in a few clicks 💸 Keep costs under control ✅ Get ROI out-of-the-box 🔁 Then, repeat the process for a different project… (1/2)

2

0

5

Arcee.ai

@arcee_ai

16 days

Why small language models are the next big thing in AI

0

5

Arcee.ai

@arcee_ai

4 months

Special shout-out to Julien Chaumond @julien_c & Lucain Pouget @Wauplin at Hugging Face for their help building this epic merging playground 🚀🚀🚀 And congrats to the Arcee team as well on the release of this fantastic tool 👏👏👏 (2/2) #nlp #ai #llm #llms

0

5

Arcee.ai

@arcee_ai

26 days

🚀Just 3 days until the launch of our hosted SaaS! As #GenAI evolves towards smaller, specialized models, Arcee is leading the charge.🌟 Get an exclusive sneak peek inside Arcee Cloud & witness the power of deploying your model on our cutting-edge platform! Tour link in comments

1

0

5

Arcee.ai

@arcee_ai

3 months

Changing the world one experiment and one merge at a time...Congrats on your release @NousResearch 🙌

Nous Research

@NousResearch

3 months

Today we are releasing an experimental new model in collaboration with @chargoddard and @arcee_ai , Hermes 2 Θ, our first model merge, combining Hermes 2 Pro, and Llama-3 Instruct, and then further RLHF'ed from there. Available on HuggingFace: This model

21

60

319

0

5

Arcee.ai

@arcee_ai

4 months

Why merge 2 models vs. fine-tuning a single model? Our experts answer that for Day 17 of March Merge Madness... starting witht the reduction of the risk of catastrophic forgetting 🧠 #nlp #ai #llm #llms

0

5

Arcee.ai

@arcee_ai

28 days

Are 7B language models the future? Check out the popularity of our recently-released stats for Arcee Agent and Arcee Spark, in the video below⬇️ then you tell us! #nlp #GenAI #LLMs #SLMs

1

2

6

Arcee.ai

@arcee_ai

13 days

Want to learn how to take Llama-3.1-8B ( #llama31 ), train it on your #slack data, and get an #LLM with immediate, practical business value? Link to our guide in the comments⬇️ #NLP #GenAI

1

5

Arcee.ai

@arcee_ai

4 months

As the leader in Small Language Models for enterprises, we couldn't have said it better ourselves: check out this great @venturebeat article by @jathomason on why the GenAI world is shifting its focus from #LLMs to SLMs. #ai #nlp #LLM

The specialized nature of SLMs can lead to improved performance and efficiency in these targeted applications compared to using a more general model.

venturebeat.com

0

4

Arcee.ai

@arcee_ai

22 days

Ready to learn more about the model training techniques that helped us land our Series A? No one better to learn from than @JonKrohnLearns ! Fantastic interview on Model Merging & Spectrum✨ #nlp #GenAI #LLMs #SLMs

SuperDataScience

@superdatasci

22 days

Mark McQuade ( @mmcquade_ai_u ) and Charles Goddard ( @chargoddard ) from ( @arcee_ai ) join @JonKrohnLearns to explore revolutionary open-source techniques in LLM training, model merging and more. Watch here:

0

1

5

0

1

5

Arcee.ai

@arcee_ai

5 months

It's Day 5 of 🏀 March Merge Madness🏀 and we're bringing you one of our biggest takeaways so far... In our discussions with companies, we’ve realized this: 💡 Even though MODEL MERGING is set to TRANSFORM the world of LLMs as we know it… (1/3)

1

3

Arcee.ai

@arcee_ai

20 days

Thanks @julsimon for this handy step-by-step for testing out Arcee-Scribe 👏

Julien Simon

@julsimon

20 days

Meet Arcee-Scribe, a state-of-the-art small language model for creative writing by @arcee_ai #ai #opensource #llm #slm

0

1

0

4

Arcee.ai

@arcee_ai

9 days

🤔Wondering what you can do with 𝗔𝗿𝗰𝗲𝗲-𝗡𝗼𝘃𝗮? Here are just some of the biz use cases: ✅ Customer Service✅ Content Creation✅ Software Dev✅Data Analysis✅R&D✅Legal & Compliance ✅Education & Training... (3/4)

1

0

4

Arcee.ai

@arcee_ai

4 months

Meta just released Llama-3 and its evals are epic! Check out @Malikeh5 's & @mcquade 's experiments merging it using MergeKit ⬇ #nlp #ai #LLM #LLMs

How to Merge Llama3 Using MergeKit

... And what do we do at Arcee when an exciting new model drops? We MERGE IT on MergeKit! We walk you through the process and share the initial results.

0

4

Arcee.ai

@arcee_ai

3 months

Great news for Model Mergers: we've extended the deadline for our hackathon, co-sponsored by Arcee/MergeKit & @awscloud , to MAY 13! Full details here: 💵 💵 💵$9k in cash prizes across 3 categories! 💵 💵 💵

0

2

Arcee.ai

@arcee_ai

4 months

The Small Language Model (Show) Ep. 3: Merging and More Merging

The Small Language Model (Show) Ep. 3: Merging and More Merging

0

4

Arcee.ai

@arcee_ai

4 months

Heading to the AI summit @ MIT this week? Be sure to catch the talk on Model Merging & MergeKit by Arcee's @chargoddard - this Thursday on the MIT campus #nlp #ai #LLM #LLMs

0

4

Arcee.ai

@arcee_ai

4 months

Shout out to @reach_vb for this great thread explaining the power & ease of our MergeKit UI on @huggingface 👏 Check out the space here:

mergekit-gui - a Hugging Face Space by arcee-ai

Discussion with Mark McQuade, CEO and co-founder, Arcee.ai

Vaibhav (VB) Srivastav

@reach_vb

4 months

Kinda wild that you can merge models with SoTA techniques at the click of a button! 🤯 Presenting MergeKit UI - Drop in your config, access token and voila, you get a merged model back! Supported merging methods: 1. Model Soups 2. SLERP 3. Task Arithmetic 4. TIES 5. DARE TIES

4

29

140

0

4

Arcee.ai

@arcee_ai

3 months

Terrific must-watch chat here between @huggingface 's @julsimon & @arcee_ai 's @mmcquade_ai_u going deep on why companies are very quickly catching on to the use of smaller language models vs. the closed-source LLM behemoths #nlp #ai #GenAI

In this insightful interview, I sit down with Mark McQuade, the founder and CEO of Arcee.ai - a forward-thinking startup revolutionizing the language model s...

Arcee/Mergekit launch Model Merging Hackathon

0

1

4

Arcee.ai

@arcee_ai

4 months

Big news today for MODEL MERGERS: the chance to win 💰💰💰! Arcee is hosting a MODEL MERGING HACKATHON with a total of $9k in prizes across 3 categories. Details in our blog: #nlp #ai #LLM #LLMs

Arcee & MergeKit advance model merging innovations with launch of MergeKit Hackathon, co-sponsored by AWS. Submit your model merging research, experiments, and results for the chance to win cash...

arcee-ai/agent-data · Datasets at Hugging Face

0

1

4

Arcee.ai

@arcee_ai

16 days

Small language models rising as Arcee AI lands $24M Series A

0

4

Arcee.ai

@arcee_ai

15 days

Announcing the general availability of the @MongoDB AI Applications Program (MAAP)! Here at @arcee_ai we're excited to be a part of this incredible ecosystem and are ready to help customers take advantage of #AI . Learn more here: #MAAPLaunch

0

1

4

Arcee.ai

@arcee_ai

4 months

How do we deliver high-quality domain-specific language models at a fraction of the cost of other companies? Check out our white paper: #nlp #llm #llms #ai

0

1

4

Arcee.ai

@arcee_ai

22 days

VentureBeat exclusive:

Arcee AI is enabling small language models with a $24M Series A funding round and the launch of Arcee Cloud. This innovative platform offers a hosted SaaS version of their AI, complementing the...

venturebeat.com

0

4

Arcee.ai

@arcee_ai

3 months

In Ep. 4 of The SLM (Small Language Model) Show, we have @jeffboudier w/ the latest from @huggingface Hub. Also, @chargoddard RE the MergeKit GUI & Evolutionary Model Merging. Join us LIVE on YouTube May 1 @ 11pm PT / 2 pm ET. #nlp #ai #LLM #LLMs

The SLM Show Episode 4: All Things Hugging Face Hub w/ Jeff Boudier

For Episode 4 of the SLM (Small Language Model) Show, we're bringing you a chat with Jeff Boudier for the latest on the Hugging Face Hub. Whether you're a ne...

The Small Language Model (Show) Ep. 3: Merging and More Merging

0

1

3

Arcee.ai

@arcee_ai

4 months

Coming up tomorrow 11am PT/2pm ET: All about Model Merging, w tips from MergeKit founder @chargoddard & a chat w/ #AI Researcher/Model Merger @Maya_Akim . Live on LinkedIn & also on YouTube: Hosted by @mmcquade_ai_u & @MaryMacCarthy #nlp #LLM #LLMs

With interest in Model Merging growing by the day, we're giving you another full episode devoted to the Magic of Model Merging. Join us live to learn the lat...

Case Study: Innovating Domain Adaptation through Continual Pre-Training and Model Merging

Arcee.ai

@arcee_ai

4 months

The Small Language Model (SLM) Show is giving you another full episode devoted to the Magic of Model Merging. Join hosts @mmcquade_ai_u & @marymaccarthy , MergeKit founder @chargoddard , & special guest @Maya_Akim next Weds 11am PT/2pm EST: #nlp #LLM #LLMs

0

2

5

0

2

Arcee.ai

@arcee_ai

3 months

In the countdown to the May 13 deadline for the Model Merging Hackathon co-sponsored by Arcee & @awscloud , here's a 🧵 w/ tips for Mergers–from MergeKit founder @chargoddard : 💡If you're trying to merge 2 models (and exactly 2), SLERP is always a good first choice... (1/3)

1

0

3

Arcee.ai

@arcee_ai

4 months

Terrific seeing the enthusiasm around Arcee's work to democratize LLMs during our CTO/Co-Founder Jacob Solawetz's talk @ #MadHats AI, co-presented with Ganapathi Krishnamoorthi of AWS Trainium. Jacob pictured w/ Rohit Talluri & Nick Hartman of AWS 🚀 🚀 🚀 #nlp #ai #LLMs

0

2

Arcee.ai

@arcee_ai

3 months

By now most of us know what Model Merging is. But have you ventured into Evolutionary Model Merging? That's the topic of our show this week, featuring @chargoddard , Arcee CTO @JacobSolawetz , AND a new Co-Host, @Malikeh5 ! Live here on X @ 11am PT / 2pm ET this Wednesday...

1

2

3

Arcee.ai

@arcee_ai

5 months

... Shamane Siri, @Malikeh5 Ehghaghi, Luke Meyers, Vladimir Karpukhin, @chargoddard , & @mmcquade_ai_u . (3/3) #nlp #ai #llm #llms

We show how Arcee uses the most innovative Continual Pre-Training and Model Merging techniques to deliver high-quality domain-specific language models at a fraction of the cost of our competitors–u...