![Krrish Profile](https://pbs.twimg.com/profile_images/1298587542745358340/DZv3Oj-h_x96.jpg)
Krrish
@krrish_dh
Followers
2K
Following
1K
Statuses
2K
building @LiteLLM π (YC W23) π https://t.co/vxWfzbjnRo DMβs open to chat about Berri π
try berri for free β
Joined August 2020
5οΈβ£ new things @LiteLLM π Anthropic - [BETA] Citations API support β‘οΈ O3-mini - native streaming support π Security - mask redis sensitive keys on `/cache/ping` π§ Azure - Timeout error includes passed timeout + elapsed time β
Rerank - infinity rerank endpoint fix
0
0
2
5οΈβ£ new things @LiteLLM π OIDC - Scope-based model access support π οΈ UI - fix showing internal user their created keys π§Ή UI - add user id attribution to created team keys πͺ Google AI Studio - gemini-2.0-flash + flash-lite pricing β‘οΈ Azure - fix setting max_retries=0
0
0
0
5οΈβ£ new things @LiteLLM πΈ Vertex AI - Gemini-2.0-flash pricing + model info added πͺ Key RPM - improved rpm tracking during high traffic π οΈ Azure - pydantic response_format + tool calls input fix β‘οΈ Azure - o3 native streaming support π Nvidia NIM - `dimensions` param added
0
0
2
5οΈβ£ new things @LiteLLM π JWT Auth - support OIDC 'role' based proxy access π Logging - Dynamic Message Redaction support π οΈ Deepseek - fix openai sdk raw response error π UI - Fix serving UI on custom base path π§Ή Prometheus - fix setting key budget with custom metadata
0
0
3
5οΈβ£ new things @LiteLLM β
[PR] Cohere - add /v2/chat cost tracking π§Ή [PR] OpenAI - bump for reasoning_content π [PR] Prometheus - fix metric label count πͺ [PR] Key Mgt - patch /key/update security π [PR] User Mgt - add budget to /user/new
0
0
0
5οΈβ£ new things @LiteLLM: π O3: Added reasoning_effort param πͺ LLM: devβsys role translation for non-OpenAI β‘οΈ OpenRouter: Fixed "include_reasoning" param passing π Team Mgmt: SSO/IDP onboarding π Team Mgmt: autosuggest users on team member add
0
0
0
5οΈβ£ new things @LiteLLM π JWT Auth - control user model access by AD 'groups' π JWT Auth - new `sso_user_id` field in db πͺ Team Mgmt - prevent duplicate member add πͺ Team Mgmt - raise error on `/team/member_delete` if user not in team π Docs - New `-stable` release
1
0
1
5οΈβ£ new things @LiteLLM π Guardrails - enforce `default_on` works on all requests πͺ Logging - disable `no-log` clientside param π Key Rotations - new doc + walkthrough π UI - new 'public team's' for easy user onboarding βοΈ [PR] Logging - improved key masking in debug logs
0
0
0
5οΈβ£ new things @LiteLLM πͺ¨ Bedrock - new `bedrock/converse_like/` route πΈ XAI - Model Pricing added π οΈ UI - fix key creation for internal users on UI πͺ Tokenizers - new `disable_hf_tokenizer_download` param for offline usage π§Ή Pydantic - cleanup valid config keys error
0
0
0
5οΈβ£ new things @LiteLLM π Guardrails - support caching across multiple event hooks πͺ Text Completion - `completion` logprobs transformation support β‘οΈ Databricks - `tools` and `tool_choice` params added π₯ MERGED - Bedrock Nova doc parsing β
MERGED - RBAC Model Access
0
0
0
5οΈβ£ new things @LiteLLM π SSO/JWT Auth - Role based model access support πͺ RBAC - new `role_permissions` config π Timeouts - pass dynamic timeouts in headers β
Tokenizer - handle hf tokenizer network call fails π OpenAI - new `metadata` param, preview support
0
0
1
5οΈβ£ new @LiteLLM π Bedrock - faster async image url converse calls β
Bedrock - Nova all files work (csv+) πͺ Anthropic - nested json on proxy fix π₯ Proxy - high load + hanging request tests β‘οΈ Deepseek - stream + reasoning content support
0
0
2
5οΈβ£ new things @LiteLLM πΈ Bedrock - model pricing updates + improved testing πͺ Cost Tracking - support `base_model` on all endpoints π οΈ Custom Pricing - fix setting cost per token pricing π UI - allow user to 'join' available teams π Docs - calling Bedrock via internal proxy
0
0
2
5οΈβ£ new things @LiteLLM πΆ Datadog - `/health/services` endpoint support πͺ Bedrock - spend tracking with region name fix π§Ή Replicate - (sync) processing status retry π οΈ UI - custom branding image fix π UI - new version update w/ guardrails support
0
0
2
5οΈβ£ new things @LiteLLM π Ollama - ssl verify = False support in call β‘οΈ Headers - NEW `timeout` + `attempted_retry` headers πͺ End-user - support end-user id passed in as 'int' π§Ή SpendLogs - drop bad log causing db errors π SDK - New 'provider_specific_header' param
0
0
0
5οΈβ£ new things @LiteLLM π Deepseek - R1 support w/ 'reasoning_content' β‘οΈ Deepseek - streaming 'reasoning_content' support π οΈ Watsonx - space id env var check fix πͺ VertexAI Anthropic - support dropping `anthropic-beta` headers π§Ή Swagger - fix custom docs rendering issue
0
0
2
5οΈβ£ new things @LiteLLM π Model Analytics - free UI model analytics π Bedrock - streaming error exception mapping πͺ Router - fix num_retries=0 not being passed βοΈ Timeout - timeout value added to openai/vllm error message β
Watsonx - stream_timeout support
0
0
1
5οΈβ£ new things @LiteLLM π Fallbacks - model auth-check on client-side fallbacks π₯ Health check - Kill model request if taking too long π UI - Fix Team spend calc. on Key pane π JWT-Auth - NEW 'enforce_rbac' param π JWT-Auth - support end user cost tracking on admin token
0
0
0
5οΈβ£ new things @LiteLLM β‘οΈ Bedrock - 10x perf improvement on async image url calls πͺ Anthropic - handle nested pydantic objects π₯ Router - high-traffic model hanging fixes π UI - fix team member role check π UI - allow team admin to delete any team key
0
0
1