krrish_dh Profile Banner
Krrish Profile
Krrish

@krrish_dh

Followers
2K
Following
1K
Statuses
2K

building @LiteLLM πŸ‡ (YC W23) πŸ‘‰ https://t.co/vxWfzbjnRo DM’s open to chat about Berri πŸ‘‹

try berri for free ➜
Joined August 2020
Don't wanna be here? Send us removal request.
@krrish_dh
Krrish
18 hours
5️⃣ new things @LiteLLM πŸš€ Anthropic - [BETA] Citations API support ⚑️ O3-mini - native streaming support πŸ”’ Security - mask redis sensitive keys on `/cache/ping` πŸ”§ Azure - Timeout error includes passed timeout + elapsed time βœ… Rerank - infinity rerank endpoint fix
Tweet media one
0
0
2
@krrish_dh
Krrish
2 days
5️⃣ new things @LiteLLM πŸ‘‹ OIDC - Scope-based model access support πŸ› οΈ UI - fix showing internal user their created keys 🧹 UI - add user id attribution to created team keys πŸ’ͺ Google AI Studio - gemini-2.0-flash + flash-lite pricing ⚑️ Azure - fix setting max_retries=0
Tweet media one
0
0
0
@krrish_dh
Krrish
3 days
5️⃣ new things @LiteLLM πŸ’Έ Vertex AI - Gemini-2.0-flash pricing + model info added πŸ’ͺ Key RPM - improved rpm tracking during high traffic πŸ› οΈ Azure - pydantic response_format + tool calls input fix ⚑️ Azure - o3 native streaming support πŸš€ Nvidia NIM - `dimensions` param added
Tweet media one
0
0
2
@krrish_dh
Krrish
4 days
5️⃣ new things @LiteLLM πŸŽ‰ JWT Auth - support OIDC 'role' based proxy access πŸ‘‹ Logging - Dynamic Message Redaction support πŸ› οΈ Deepseek - fix openai sdk raw response error πŸš€ UI - Fix serving UI on custom base path 🧹 Prometheus - fix setting key budget with custom metadata
Tweet media one
0
0
3
@krrish_dh
Krrish
5 days
5️⃣ new things @LiteLLM βœ… [PR] Cohere - add /v2/chat cost tracking 🧹 [PR] OpenAI - bump for reasoning_content πŸ‘‹ [PR] Prometheus - fix metric label count πŸ’ͺ [PR] Key Mgt - patch /key/update security πŸš€ [PR] User Mgt - add budget to /user/new
0
0
0
@krrish_dh
Krrish
6 days
5️⃣ new things @LiteLLM: πŸ‘‹ O3: Added reasoning_effort param πŸ’ͺ LLM: devβ†’sys role translation for non-OpenAI ⚑️ OpenRouter: Fixed "include_reasoning" param passing πŸš€ Team Mgmt: SSO/IDP onboarding πŸŽ‰ Team Mgmt: autosuggest users on team member add
Tweet media one
0
0
0
@krrish_dh
Krrish
8 days
5️⃣ new things @LiteLLM πŸ‘‹ JWT Auth - control user model access by AD 'groups' πŸŽ‰ JWT Auth - new `sso_user_id` field in db πŸ’ͺ Team Mgmt - prevent duplicate member add πŸ’ͺ Team Mgmt - raise error on `/team/member_delete` if user not in team πŸ“– Docs - New `-stable` release
Tweet media one
1
0
1
@krrish_dh
Krrish
9 days
5️⃣ new things @LiteLLM πŸ‘‹ Guardrails - enforce `default_on` works on all requests πŸ’ͺ Logging - disable `no-log` clientside param πŸ”‘ Key Rotations - new doc + walkthrough πŸš€ UI - new 'public team's' for easy user onboarding βŒ›οΈ [PR] Logging - improved key masking in debug logs
Tweet media one
0
0
0
@krrish_dh
Krrish
10 days
5️⃣ new things @LiteLLM πŸͺ¨ Bedrock - new `bedrock/converse_like/` route πŸ’Έ XAI - Model Pricing added πŸ› οΈ UI - fix key creation for internal users on UI πŸ’ͺ Tokenizers - new `disable_hf_tokenizer_download` param for offline usage 🧹 Pydantic - cleanup valid config keys error
Tweet media one
0
0
0
@krrish_dh
Krrish
11 days
5️⃣ new things @LiteLLM πŸš€ Guardrails - support caching across multiple event hooks πŸ’ͺ Text Completion - `completion` logprobs transformation support ⚑️ Databricks - `tools` and `tool_choice` params added πŸ”₯ MERGED - Bedrock Nova doc parsing βœ… MERGED - RBAC Model Access
Tweet media one
0
0
0
@krrish_dh
Krrish
12 days
5️⃣ new things @LiteLLM πŸŽ‰ SSO/JWT Auth - Role based model access support πŸ’ͺ RBAC - new `role_permissions` config πŸ‘‹ Timeouts - pass dynamic timeouts in headers βœ… Tokenizer - handle hf tokenizer network call fails πŸš€ OpenAI - new `metadata` param, preview support
Tweet media one
0
0
1
@krrish_dh
Krrish
14 days
5️⃣ new @LiteLLM πŸ‘‹ Bedrock - faster async image url converse calls βœ… Bedrock - Nova all files work (csv+) πŸ’ͺ Anthropic - nested json on proxy fix πŸ”₯ Proxy - high load + hanging request tests ⚑️ Deepseek - stream + reasoning content support
Tweet media one
0
0
2
@krrish_dh
Krrish
15 days
5️⃣ new things @LiteLLM πŸ’Έ Bedrock - model pricing updates + improved testing πŸ’ͺ Cost Tracking - support `base_model` on all endpoints πŸ› οΈ Custom Pricing - fix setting cost per token pricing πŸŽ‰ UI - allow user to 'join' available teams πŸ“– Docs - calling Bedrock via internal proxy
Tweet media one
0
0
2
@krrish_dh
Krrish
16 days
5️⃣ new things @LiteLLM 🐢 Datadog - `/health/services` endpoint support πŸ’ͺ Bedrock - spend tracking with region name fix 🧹 Replicate - (sync) processing status retry πŸ› οΈ UI - custom branding image fix πŸš€ UI - new version update w/ guardrails support
Tweet media one
0
0
2
@krrish_dh
Krrish
17 days
5️⃣ new things @LiteLLM πŸŽ‰ Ollama - ssl verify = False support in call ⚑️ Headers - NEW `timeout` + `attempted_retry` headers πŸ’ͺ End-user - support end-user id passed in as 'int' 🧹 SpendLogs - drop bad log causing db errors πŸš€ SDK - New 'provider_specific_header' param
Tweet media one
0
0
0
@krrish_dh
Krrish
18 days
5️⃣ new things @LiteLLM πŸ‘‹ Deepseek - R1 support w/ 'reasoning_content' ⚑️ Deepseek - streaming 'reasoning_content' support πŸ› οΈ Watsonx - space id env var check fix πŸ’ͺ VertexAI Anthropic - support dropping `anthropic-beta` headers 🧹 Swagger - fix custom docs rendering issue
Tweet media one
0
0
2
@krrish_dh
Krrish
19 days
5️⃣ new things @LiteLLM πŸŽ‰ Model Analytics - free UI model analytics πŸ‘‹ Bedrock - streaming error exception mapping πŸ’ͺ Router - fix num_retries=0 not being passed βŒ›οΈ Timeout - timeout value added to openai/vllm error message βœ… Watsonx - stream_timeout support
Tweet media one
0
0
1
@krrish_dh
Krrish
20 days
5️⃣ new things @LiteLLM πŸš€ Fallbacks - model auth-check on client-side fallbacks πŸ₯ Health check - Kill model request if taking too long πŸ‘‹ UI - Fix Team spend calc. on Key pane πŸ”’ JWT-Auth - NEW 'enforce_rbac' param πŸŽ‰ JWT-Auth - support end user cost tracking on admin token
Tweet media one
0
0
0
@krrish_dh
Krrish
22 days
5️⃣ new things @LiteLLM ⚑️ Bedrock - 10x perf improvement on async image url calls πŸ’ͺ Anthropic - handle nested pydantic objects πŸ”₯ Router - high-traffic model hanging fixes πŸš€ UI - fix team member role check πŸŽ‰ UI - allow team admin to delete any team key
Tweet media one
0
0
1
@krrish_dh
Krrish
23 days
5️⃣ new things @LiteLLM πŸ‘‹ Cooldowns - for single-deployment model groups in high-traffic πŸ’ͺ LM Studio - none api key support πŸ› οΈ Fallbacks - sdk duplicate key error fix βœ… Vision - ` http://` url support on VertexAI + Bedrock 🧹 Codestral - stream chunk parsing fix
Tweet media one
0
0
3