LiteLLM (YC W23)
@LiteLLM
Followers
2,223
Following
116
Media
73
Statuses
569
Call every LLM API like it's OpenAI 👉
try it today ➜
Joined December 2022
Don't wanna be here?
Send us removal request.
Explore trending content on Musk Viewer
#ใจซ่อนรักEP5
• 710863 Tweets
LINGORM TSOU EP5
• 700347 Tweets
Cheatle
• 423334 Tweets
#ブルアカ
• 265002 Tweets
Secret Service Director
• 210262 Tweets
सुप्रीम कोर्ट
• 141610 Tweets
ログイン
• 65831 Tweets
Jamaican
• 64269 Tweets
Nancy Mace
• 52858 Tweets
Roro
• 52444 Tweets
travis
• 51594 Tweets
#KingOfHeartsJaehyukDay
• 45432 Tweets
Our Shining Star Yoon Jaehyuk
• 43806 Tweets
Rajoy
• 43503 Tweets
#いつもしあわせでいてくれたらありがとう
• 40009 Tweets
Jim Jordan
• 34817 Tweets
Raskin
• 33435 Tweets
Kris Tyson
• 30606 Tweets
シロコテラー
• 30459 Tweets
谷川俊太郎
• 20784 Tweets
Spawn
• 16067 Tweets
Çanakkale
• 15643 Tweets
臨戦ホシノ
• 14871 Tweets
Bodrum
• 12630 Tweets
灼熱カバディ
• 11649 Tweets
Chalobah
• 10091 Tweets
Posting 500 flyers around SF today.
Hitting up: fidi, marina, Hayes, South Park 💪💪
Check out ReliableGPT today!!
8
2
30
Tomorrow, 10AM Start: Come build your GPT-3 apps with us tomorrow:
🍇 BerriAl Swag for All
🎁 Special Prizes for the Top 3 Winners
🤖 Build your LLM apps in minutes
0
3
18
BERRI ON THE STREETS!! Celebrating our Launch
@ishaan_jaff
will be distributing stickers and berries around cafes in SF 🍇🍇
2
3
13
Berri's () first hackathon is in the books!!
Thank you to everyone that showed up, and all the awesome projects that got built. We'll be showcasing some of these, over the next few days!!
2
2
13
😱 BerriAI on the Times Square Billboard!!
👉 Join us tmrw for the world's largest chatGPT Hackathon:
📣 s/o to
@brexHQ
#GrowWithBrex
for makingt his happen
0
0
12
🪄✨ Introducing Pipelines.
🙇🏻♂️ Ever felt stuck trying to figure out the right chunking/vectorizing/search strategy for your LLM App?
🚀 Pipelines let you spin up an LLM App in 2-lines of code.
Want help? Join us today and launch in 30mins 👉
2
0
11
📣Announcing
#HackAI
's 1st speaker -
@RazRazcle
👀
@humanloop
does some incredible work in enabling co's to bring LLM's to production. Catch his talk @
#HackAI
this weekend.
👉 Register for the event:
1
6
11
🤔 Using chatGPT for answering customer questions?
👀 Want to give it the conversation history?
😱 Just pass the history to your Berri api endpoint, and we'll manage the rest
Learn more 👉
0
2
9
New release updates:
🦙 added support for
@gpt_index
- thanks
@ravithejads
👻 added support for wrapper functions - thanks
@HingumTringum
🐛 fixed a bug which wasn't parsing 'with' statements
try berri today 👉
1
3
9
BerriAI just launched on
@ycombinator
's Launch YC!
🚅 LiteLLM - Call all LLM APIs using the OpenAI format [Llama2, Anthropic, Huggingface, etc.]. Check them out:
0
2
9
If you're a data scientist and your boss tells you to get this built in a week, use Berri and enjoy the remaining 6 days of vacation :)
if you’re a data scientist and your boss tells you to just get this built in a week, i’m sorry and we’re hiring
3
0
46
0
1
8
add it today -
New integration:
@LiteLLM
You can log requests using Supabase across all LLM Providers
@OpenAI
,
@Azure
,
@huggingface
, and more!
Learn more:
3
6
90
0
1
8
Berri builds in public 😤
🤫P.S.:
@krrish_dh
and
@ishaan_jaff
have something special planned for our first 1000 deploys 👀
0
1
8
ANNOUNCING T5 🔥🔥
Need an alternative to GPT? Want it to be deployed on your infra?
PRESENTING T-5!!
Live on the playground today 👉
Live on the API 👉
0
1
6
EOD - had 130 ppl try and deploy w/ 59 successful. Lots to fix in the pipeline. Tomorrow we go for the remaining 138 deploys.
3
0
7
First stop - Another Cafe.
If you’d like to get an in-person demo, drop a comment here / dm me and I’ll make my way over.
1
0
7
🚀 5 updates to LiteLLM 🚅
👋
@helicone_ai
+
@supabase
integrations for auto-logging LLM responses
👀
@infisical
integration for reading in your API token
🥳 exposing `api_version` and `org id`
🛠️ fixes to exception-mapping
✅ Support for async calls
0
1
7
👀QA on your codebase.
✈️we're running pilots..
👇drop a link to a github you'd like this for
0
3
6
@Shagn1000
@Teknium1
@dctanner
@levelsio
Fyi
@Teknium1
,
@Shagn1000
we launched a new Load balancer on LiteLLM it can 20x your throughput on Ollama, vLLM, any Litellm supported model. Here's how to use it
0
0
6
New
@cohere
embedding model on LiteLLM
💥 Thrilled to announce - DAY1 support for Cohere embed v3 models on LiteLLM (it promises better performance than OpenAI embeddings) Try it here:
⚡️ Use LiteLLM Proxy to compare 100+LLMs on LM Eval Harness benchmarks:
1
1
17
0
0
4
huge thanks to
@sebderhy
for the help 😃
LiteLLM v0.13.0 ⚡️ Support for
@anyscalecompute
endpoints with streaming live now. Try it here: s/o to
@sebderhy
for the help
🔎 Use LiteLLM to easily benchmark Hugging Face LLMs
2
1
17
0
0
5
Berri Lightning Hacks:
You can now query an API url straight from .
Seen below: an api call to semantic scholar, getting all relevant papers and turning it into a chat interface [IN UNDER 2 minutes]
0
0
5
Use
@huggingface
TGI LLMs with ALL OpenAI compatible benchmarking tools
💥 Trying to evaluate if the latest LLM is good for production ? LiteLLM proxy allows you to run
@huggingface
TGI LLMs (100+LLMs) on LM Eval Harness
🪨 Supper for Bedrock amazon.titan-embed-text-v1 LIVE
1
2
11
0
1
4
❤️ We just launched support for Llama-2-7b-32K-Instruct on liteLLM:
Love the awesome work done by
@togethercompute
Introducing our newest long-context model:
💬 Llama-2-7B-32K-Instruct
Fine-tuned using Together API, the model is now available to use with our APIs & Playground:
Try it out and send us feedback!
14
111
448
1
0
5
We reduced failed customer requests in prod by 80% using caching.
Open-sourcing the code to do this yourself.
0
1
5
😱 You can now create a LLM App to QA your docs straight from our website ()
🚀 If it takes you more than 15 minutes to go from idea to shareable prototype, we'll buy you coffee.
0
0
5
Afraid
#ChatGPT
is going to steal your data? 😱
Feeding in sensitive data into LLM applications is (rightfully) worrying! With solutions like
#PrivateGPT
rising in popularity, how can you harness LLM superpowers while protecting your company's data. 🧵 👇 (1/4)
1
1
4
@thorwebdev
@supabase
@thorwebdev
@Berri_AI
builds on Supabase, and we love it!
Would love to collaborate some time!
2
0
6
0
0
4
BerriAI <3 Replit
come hack with us this Saturday (03/11) in SF:
2
0
4
0
0
4
0 deploys but met some dope ppl. Back on track to chipotle @ Fidi
2
0
4
Just stopped by LinkedIn office to teach developers how to use Berri
0
0
4
THE BEST DEAL ON THE INTERNET is now here!!
Announcing: THE BEST DEAL ON THE INTERNET!!! Try now:
Unlimited
#chatGPT
instances, 10,000 queries/day, index finetuning, etc.
s/o:
@TechCrunch
for telling us that our pricing was too expensive -
0
3
28
0
0
4
Build your app with custom data + custom prompts today
🚨 Build your own chatGPT app for your data (📄) + add custom prompts at
In this demo I build an app analyzing Apple's 10k filing with a custom prompt instructing the LLM it is a financial analyst
🚀 Build with
@Berri_AI
and get a web app + API endpoint!
4
2
44
1
0
3
💥 New demo video on using LiteLLM:
0
0
3
The world's *First* Production 'auto-eval' system.
Go to and test it today 🚀
📣 Launching the world's **First** Production 'auto-eval' system
🚀 Detect hallucinations AND refusals to answer in real-time
👀 Don't believe us? Go to to try it now (and win $250 💸)
3
2
29
0
0
3
huge thanks to
@phduc06
for the awesome contribution !!!
LiteLLM v14.1 ⚡️ evaluate
@OpenAI
@cohere
,
@AnthropicAI
,
@huggingface
LLMs on 100+ benchmarks
Try here:
🍰 Major improvements to token trimmer - thanks to
@phduc06
for the awesome work on this
2
8
59
0
0
3
💥 LiteLLM v1.7.21 Proxy - Handle 1000+ requests/second with
@Azure
,
@perplexity_ai
online models,
@OpenAI
💥 Try it here:
⚡️LiteLLM Router now load balances based on each deployment RPM / TPM h/t
@mikkolehtimaki
for the load test
0
3
26
0
0
3
AAAND WE’RE DONE!! ✅✅
~500 posters put up 🆙 in <10 hrs!
Thank you for following along ❤️
Check out ReliableGPT:
0
0
2
I'm going to be launching on Product Hunt tonight ! Join my discord to stay tuned:
🚀
@Berri_AI
is launching on
@ProductHunt
tonight 12:01am. Join our Discord community to stay up-to-date with our launch: .
Here is everything we built in the last 5 days leading to the launch:
3
0
29
1
0
2
@SethDeGroot
@WillManidis
Thanks
@SethDeGroot
!
@WillManidis
if we can't get you to prod (live with this for all your users) in a week, we'll give you $100 in OpenAI credit.
0
0
2
💥 Excited to launch Day 1 support for
@AnthropicAI
Claude-3, use 100+ LLMs in one format. 👉 Start here:
0
0
2
What are wrapper functions?
For more complex use-cases. If you're taking a user query and doing multiple things (LLM calls, api calls, etc.) with it, you can put them in a wrapper function and pass the wrapper function to Berri.
0
0
2
🚨Using LiteLLM? 👉 Fill in this short form for free dedicated 1:1 support
0
0
2
Found + fixed a ui bug on berri. Had to buy Kyle a coffee for it - but it was worth it. Should be easier to put url's on the site now.
#1kIn5days
0
0
2
0
0
2
Proud to announce LiteLLM is now live on
@CodiumAI
's pr-agent repo.
1 line change and they now support 5 new LLM providers
check out the PR here -
1
0
1
@ramsri_goutham
@ramsri_goutham
are you attending
#HackAI
? Let's build our own chatGPT Plugin!
Link to event -
0
0
2
@Ollama_ai
♥️♥️♥️
💥🦙NEW LiteLLM Docker Image - OpenAI API for
@Ollama_ai
local llama2, Mistral, Code Llama here:
(Ollama is an amazing project by
@jmorgan
@mchiang0610
)
(also s/o to
@inkeep_ai
for helping me with debugging docker)
💸Track costs on LiteLLM Proxy for
0
5
18
0
0
1
🤯 Ever wished you could build your own
#Notion
chatbot?
🙇🏻♂️ Use
@gpt_index
's index +
@LangChainAI
's agent and spin up
#chatGPT
in <1min.
☕️ if it takes you any longer.. coffee's on us (Venmo:
@Krrish
-Dholakia)
0
0
2
check out
@so_claros
today!!
Added reliableGPT to pacman-prompts, and started using it in prod at
@so_claros
It's already helped us out a couple of times, especially when the OpenAI API is throwing a tantrum
Thanks
@ishaan_jaff
and
@krrish_dh
!
1
1
7
0
1
2
Starting today, you can use the documentQAPipeline.
We're going to work to optimize these flows increasingly over time - making them faster, more reliable, etc.
Want to use/contribute a pipeline for your scenario? DM us to get started!
1
0
2
For anyone randomly seeing this tweet on their feed.. check out
0
0
1
@itsmarcgreen
Hey we're able to onboard new users, text/call
@ishaan_jaff
at 412-618-6238, I will help get you set up. My email is ishaan
@berri
.ai if you prefer
0
0
1
Awesome integration with liteLLM, check it out ❤️
🔥 New project alert 🔥
Introducing LLMonitor: an open-source observability and monitoring platform for AI apps:
📈 Analytics on requests
💸 Cost monitoring (for OpenAI & Anthropic)
🤖 Tracing to debug agents
📜 Logging of prompts and results
👨👩👧 User tracking
🧑💻 Self-hostable
5
2
26
0
0
1
@chengdujin
what was not working when you tried `format=json` with LiteLLM? Will fix the issue
2
0
0
0
0
1
@lucas_hofer
@lateinteraction
thanks for mentioning us
@lucas_hofer
!
@lateinteraction
would love to be helpful, here's our Github: let me know if you need anything
0
0
1
0
0
1
