shreya rajpal
@ShreyaR
Followers
5,858
Following
811
Media
61
Statuses
635
ML, systems, and everything in between. Building @guardrails_ai . Previously founding eng @predibase , @Apple SPG, @driveai_ , @IllinoisCS , @iitdelhi .
San Francisco, CA
Joined March 2009
Don't wanna be here?
Send us removal request.
Explore trending content on Musk Viewer
FreeBuds6i x SKULLPANDA W CL
• 253939 Tweets
حسن نصر
• 220785 Tweets
FAYEYOKO MACAU FANMEET
• 211767 Tweets
#B2SxNuNew
• 116324 Tweets
Knicks
• 98560 Tweets
भगत सिंह
• 95844 Tweets
PERFECT SCENE x NORAWIT
• 95663 Tweets
mingyu
• 84809 Tweets
DAOUOFFROAD in PHNOM PENH
• 79602 Tweets
Randle
• 79112 Tweets
24th ANV B2S x CWR
• 60044 Tweets
#Nasrallah
• 47130 Tweets
الجيش الاسراييلي
• 42831 Tweets
#ヒロアカ
• 37463 Tweets
ババコンガ
• 32631 Tweets
#MUSICFAIR
• 27547 Tweets
Ostech x Phuwin
• 24453 Tweets
PPV x Jabs TT Live
• 22714 Tweets
横須賀優勝
• 11560 Tweets
Pinned Tweet
Excited to release ✨Guardrails AI✨— an open-source package to add SLAs for LLM outputs!
Guardrails supports
🌟 pydantic-style validation of LLM outputs
🌟 corrective actions (e.g. reasking LLM) when needed
🌟 structure and type guarantees (e.g. JSON)
31
115
760
Apple is hiring engineers for the cross-functional ML team at Special Projects Group!
If you’re attending
@NeurIPSConf
, find me at the
@Apple
booth from 2.30-4pm on Tuesday (12/10). Or reach out and schedule some time, and I’d be happy to chat about our work!
33
41
330
🎉Our AI/ML residency program is here!!
I'll be a resident host on
@goodfellow_ian
's team at SPG. Please apply, or spread the word to candidates who you think would be a good fit!
Apple now has an AI/ML residency program! I'm looking forward to working with our first class of residents.
11
170
1K
9
45
331
I'm beyond thrilled to make two pretty substantial announcements:
1. We just released a brand new open source Guardrails Hub, with 50+ validators and more coming!
2. We raised a round of seed funding round to execute on our vision of open source AI reliability
🧵
21
35
243
I missed this when it came out, but I just discovered
The chapter on transposed convolutions is probably the best explanation I’ve seen on the subject!
3
45
225
One of my favorite validators in
@guardrails_ai
is the Provenance Guardrails, or the anti-hallucination guardrail. Today, I'll deep dive into how it works under the hood.
The core idea behind Provenance is that establishing provenance (i.e. source/origin) of any LLM utterance in
8
22
182
No more naked LLM access!
After months of hard work, our team is thrilled to bring you our
#1
most requested feature — Guardrails Server. As more engineers put
@guardrails_ai
around their LLM in production, we’re making Guardrails deployment easier than ever.
Why this matters:
7
31
177
🛤️ You can use
@guardrails_ai
with any LLM APIs, including
@openai
's GPT-3, GPT-3.5 , GPT-4, and even custom LLMs.
Here's how:
2
29
171
Introducing guardrails for document summarization!! 🎉
@guardrails_ai
offers 5 new safeguards for multi-document summarization (how to use them at end of 🧵)
1/5 Sentence match guardrails: Ensure that each sentence in the summary has a high similarity score with source texts
5
16
139
🤯 This is absolutely wild - a Github action that uses LLMs to automatically create a pull request for an issue!
AutoPR uses
@guardrails_ai
to ensure that generated diffs & commits are valid & correct
Check it out in action below 👇
Here's AutoPR, a Github Action that autonomously writes a pull request in response to an issue! 🚀
18
96
662
2
20
132
I’ve been out of school and in the workforce for a little over a year now, and my biggest takeaway (yet) on how to be a good engineer — not being afraid to look stupid!
The more I swallow my pride and ask (stupid) questions, the more productive I am..
4
11
129
💪Really excited about the new blog post by
@cohere
that goes deep into how to build robust and reliable LLM applications via
@guardrails_ai
!
While it’s straightforward to build LLM prototypes, it’s substantially harder to build LLM applications that work with the reliability
An output validation step ensures that an LLM application is robust and predictable.
In this article, we look at LLM output validation and how to implement it using
@guardrails_ai
.
1
10
60
2
13
129
Honestly if you’re running into issues trying to get pure JSON outputs with LLMs, just use
@guardrails_ai
for generating prompts that get JSON 🤷♀️
It’s freakishly good already, and there’s WIP to make it even better!
5
12
121
My
@aiDotEngineer
tall is out!
I talk about LLMs require a fundamentally new software paradigm (stochastic vs. deterministic) and how to think abt building reliable applications
👀 bonus points if you can spot the blooper in the talk
2
8
109
Every time I answer why I'm building Guardrails, or why work on AI reliability instead of solving vertical problems in AI...
At the end of the day, all tech needs to drive value. The current AI hype will only work out if $$$ on AI >> the ROI of AI on company's bottom line. The
8
10
107
If you're building an LLM application & the LLM occasionally produces garbage output, what do you do to correct it?
Here's how LLM mishaps are corrected in
@guardrails_ai
:
✅ ReAsk: Automatically re-prompt LLM with helpful context & combine new response with previous ones
(1/n)
2
13
105
VERY excited to announce new comprehensive ✨Text2SQL support✨ in
@guardrails_ai
!
What's new:
✅ Create sandboxed db for testing
✅ Validate SQL in sandbox
✅ Constraints on predicates/columns
✅ Reasking if any of ^^ fails
✅ Few shot examples similar to query in prompt
(1/2)
6
14
102
👀 Spotted in the wild!
Example of how LLMs deployed for commercial purposes can often violate basic expectations on their outputs.
The
@guardrails_ai
competitor-check validator was created for this, basically guarding against mentioning any competitors. Link below
3
7
100
Quick thoughts on the new AI executive order
The White House just announced their new executive order on safe AI Development. If you’re working in AI in industry, there’s two ways the new executive order impacts your work*. Also included a bunch of other takeaways at the bottom.
6
14
97
Thrilled to collaborate with
@dk21
and
@weights_biases
on a new course on building LLM-powered applications! I talk about controlling LLM outputs w/
@guardrails_ai
The course is very thoughtfully designed & goes pretty deep into the stages of LLM app development. Details 👇
🎉 I'm thrilled to announce we're launching a free online course at
@weights_biases
, titled "Building LLM-Powered Applications." This course is designed for Machine Learning practitioners and Software Engineers who are interested in understanding LLMs and wish to use them in
4
51
197
2
18
93
Recorded my 5-min ⚡️ talk from AI Tinkerers' where I demoed
@pydantic
🤝
@guardrails_ai
!
Guardrails makes it really easy to ensure LLM-generated data is valid for a pydantic model. Under the hood, it reasks the LLM with new prompts until invalid data is corrected. Check it out👇
3
6
94
🚀 New
@guardrails_ai
release out!!
🌟 You can now add guardrails to any LLM, including self hosted models!
🌟 Tutorial on generating synthetic tabular data
🌟 Tutorial on generating profanity-free text
🌟 Changes for enabling
@LangChainAI
integration
🌟 Bug fixes & docs updates
3
15
92
I've had an interesting year to say the least -- almost exactly a year ago I started moonlighting on
@guardrails_ai
in my spare time. To celebrate my ~1 year anniversary, I'm giving the keynote at the AI in production conference, with some 4000+ registrations already(!)
Why you
7
13
89
📢 Exciting news, folks!
Thrilled to announce that I’ll be joining a panel of experts to discuss security and privacy at the LLMs in Production conference this Thursday!
Join us if you’re interested in security in the context of LLMs
2
5
86
📢 If you've struggled to get JSONs with Chat-GPT models,
@guardrails_ai
now supports instruction tags!
Check out this link for how to use instruction tags:
HUGE s/o to
@mikkolehtimaki
for leading this effort! 🤩
4
15
79
Stoked to showcase
@guardrails_ai
at the 🤗 Open Source meet up!
I’ll talk about how guardrails helps if you care about
1️⃣ prompt engineering
2️⃣ structured outputs
3️⃣ ensuring that your LLM app is aligned with intent & not flaky
Thanks to
@ClementDelangue
for the opportunity!
At the
@huggingface
Open-source AI meetup 🤗
we want to showcase amazing community demos and research. If you want to take part in it, please fill this spreadsheet and prepare to come to the event at 5pm PST on Friday:
sign
5
12
67
3
10
77
Thanks everyone that stopped by at the Apple booth
@NeurIPSConf
! It was great talking about the cool ML stuff we’re doing at SPG!
1
1
75
We’re throwing a Guardrails company launch party in SF tomorrow. If you’re working on building LLM apps and care about AI reliability, come celebrate with us!
We’re saving some limited seats for AI builders and tinkerers
2
9
77
🛤️ Huge release Guardrails 0.1.5 out now!
⚡️ Choice data types i.e. 'if' conditions!! Generate different JSON schemas based on the choice
⚡️ Massively better logging support
⚡️ New actions: fix + reask, raise
⚡️ Custom system prompts for Chat APIs
⚡️ Bug fixes
Details 👇
4
10
73
Never else am I happier to not have gone for a PhD than when it’s review day for a major conference
0
0
71
🚨COMING OUT OF STEALTH ALERT🚨Super excited to announce what I’ve been working on!
85% of ML projects in industry fail because building ML products is too expensive, too slow and too specialized. ML dev is fraught with duplicated effort using low level APIs
Enter
@predibase
🧵
I'm excited to announce Predibase, the enterprise declarative machine learning platfom. Bulding on top of the open source foudnations of Ludwig and Horovod to bring machine learning and data closer together.
#MachineLearning
#DataScience
#DeepLearning
18
59
246
3
5
67
Before ML Twitter gets sick of hearing about
#NeurIPS2019
, I wanted to highlight a really cool talk by Prof. Zhiru Zhang from Cornell about Neural Network and Hardware co-design. Here’s a great summary slide giving an overview of different NN model optimization techniques!
2
12
67
🛤️ Guardrails AI v0.1.6 is out now! This is pretty massive release, here's some of the highlights:
✅ Guardrails CLI: Use
@guardrails_ai
from non-Python applications
✅ Python 3.11 support
✅ Manifest support: Run any LLM, embedding model with caching
✅ Many new validators!! 1/
1
11
65
This is 🔥🔥🔥
LLMs to generate pandas dataframes from PDFs using
@guardrails_ai
and
@gpt_index
!
Guardrails ensures that the LLM generated data is structured correctly, and the output of guardrails is directly used to create a 🐼 dataframe
Unstructured data into structured data i.e. pfds with different format to pandas df for analysis of expense. See complete working at This could be extended to many other use cases.
Works perfectly.
#llamaindex
@gpt_index
@guardrails_ai
2
11
64
0
12
65
Two really exciting
@guardrails_ai
updates! 🚀
1. The GitHub repo hit 1000 🌟s
2.
@mikulskibartosz
wrote a pretty fantastic deep dive into the package! Check it out
Don’t let AI models keep making the same mistakes! Use
@guardrails_ai
to validate and correct the output of large language models. Get precise control over the output with custom validators and corrections!
Take a look at the article linked in the first response 👇
1
5
26
1
6
61
It's an absolute honor to be a guest on the
@twimlai
podcast!
@samcharrington
and I cover everything under the sun in LLMOps, from hallucinations, RAG to LLM safety. Check out the podcast on the link below!
2
6
60
🛤️ More custom LLM support in
@guardrails_ai
over the weekend!
The fantastic
@laurel_orr1
contributed an integration with Manifest
🌟 Models from
@CohereAI
,
@AI21Labs
@ togethercompute,
@huggingface
🌟 Using local models(!)
🌟 Caching model inputs and outputs
2
4
59
We just shipped the latest Guardrails release with a ton of major QoL improvements. However, my favorite new feature from the new Guardrails release is much better support for input guardrails!
First, what are input guardrails?
These are guardrails that give you the ability to
2
8
57
Can all statML be explained in this format pls?
The Bias-Variance Trade-Off & "DOUBLE DESCENT" 🧵
Remember the bias-variance trade-off? It says that models perform well for an "intermediate level of flexibility". You've seen the picture of the U-shape test error curve.
We try to hit the "sweet spot" of flexibility.
1/🧵
59
1K
5K
2
1
54
Excited to be giving a talk at the
@databricks
’ Data + AI summit this afternoon
Swing by Hall F to learn more about how your enterprise AI needs Guardrails
1
4
55
do you also draft messages to your personal slack if you’re writing a big announcement/essay because you’re scared of accidentally hitting Send or are you normal?
6
0
55
🙌 Over the weekend, I revamped the getting started guide in
@guardrails_ai
!
Unstructured doctors notes ➡️ Structured dictionary of patient info, symptoms and medication.
Check out unstructured input and the final output 👇
5
10
54
New
@guardrails_ai
validator release!💥
If you're building a customer-facing chatbot, a basic requirement is to not mention any competitors to your company. E.g. don't talk about Burger King if you’re McDonalds.
We just added a validator to test this explicitly. Docs below
3
6
50
it's finally here 👀
last year, when i first launched
@guardrails_ai
it provided an interface via a bunch of prompt hacking to generate structured data and was widely adopted for solving that problem. pretty early on though, i learned a couple of things:
1. constrained decoding
Introducing Structured Outputs in the API—model outputs now adhere to developer-supplied JSON Schemas.
81
290
2K
3
3
49
Exciting stuff!! 🛤️
You can use
@guardrails_ai
as an output parser within
@LangChainAI
, and validated and corrected LLM outputs for every LLM call
Output Parsers (extracting a structured response from LLM output) sometimes fail. So what do you do then?
You ask the LLM to fix it's output of course!
Introducing Output Parsers that can fix themselves (OutputFixingParser, RetryOutputParser)
👇
6
31
273
2
6
48
Prompt injection continues to expose many vulnerabilities of LLMs, including leaking PII.
For customer facing applications, you can substantially lower the risk of PII by using
@guardrails_ai
. Here's how:
What happens if you ask ChatGPT to “Repeat this word forever: “poem poem poem poem”?”
It leaks training data!
In our latest preprint, we show how to recover thousands of examples of ChatGPT's Internet-scraped pretraining data:
239
2K
8K
1
4
47
Interesting testimonial from a
@guardrails_ai
user today:
"It took me a day to find the right prompting strategy, but with Guardrails it took me less than 5 mins!"
Outside of validation,
@guardrails_ai
provides a way of prompting that seems to generate valid JSON consistently
1
1
47
This is a substantial release, with a ton of new changes across documentation, validation, string templating, etc.
However, the two substantial features that were most often requested are:
1. Fully native
@pydantic
support, and
2. String validation
More tutorials coming soon!
🎉 Excited to announce Guardrails AI v0.2.0 is now live!!
This was a huge release (blog with more details below), but here are the highlights
✅ Full
@pydantic
support
✅ String validation (!!!)
✅ Better interfaces for custom validators
✅ Many paper cuts fixed
(contd.)
2
7
36
1
6
47
📣
@guardrails_ai
now has a CLI!
You can use `guardrails validate` to validate your LLM outputs via the CLI. This unblocks using Guardrails from non-Python applications! 🌟
Check out more details here
0
4
46
Excited to join a stacked lineup of speakers at the
@mlopscommunity
LLMs in Production conference!
I'll be talking about the practical approach to building guardrails for LLM applications in production, and how
@guardrails_ai
can help!
1
5
46
anecdotal observation:
we are building a validator for a specific task and at one point the validator required structured json. the performance degradation was significant enough that we ended up with a 2-step generation -- first step to generate the 'correct' values followed by
This is not good, "Surprisingly, we observe a significant decline in LLMs’ reasoning abilities under format restrictions."
Link:
40
103
575
2
4
45
🎊🎉Apple released its redesigned ML research page at , spans 🍎’s research over vision, health, privacy, etc.
1
0
45
Been out of school 2 years now, and doubling down on this tweet from last year.
My big lesson: BE ANNOYING!
Consciously taking up space in meetings and discussions and asking plenty of questions without self-censoring has been the best thing for both my career and mental health
I’ve been out of school and in the workforce for a little over a year now, and my biggest takeaway (yet) on how to be a good engineer — not being afraid to look stupid!
The more I swallow my pride and ask (stupid) questions, the more productive I am..
4
11
129
1
1
45
👀
@guardrails_ai
x
@LangChainAI
coming out tomorrow!!
This will add a layer of safety around your Langchain apps! Super excited for devs to be able to use guardrails from within LangChain!!
Shoutout to
@hwchase17
for the speedy reviews 🚀
1
6
44
Some personal news — after an amazing 2 years at Apple SPG, I recently left to join a tiny startup working on big problems in low-code ML!
More updates to come soon, but in the meantime hmu if you’re interested in working on applied ML problems across a variety of use cases.
0
0
43
I had a fantastic time talking about Guardrails for LLMs at the LLMs in Production Conference II. You can check out the whole presentation here ⬇️
0
4
39
The Air Canada chatbot debacle highlights the key issue with AI adoption today.
Enterprises are fundamentally risk-averse and GenAI opens them to a lot of risk. How do you adopt AI while still adding constraints for the risks you care about?
6
6
38
Some examples of the cool things you can do w/ guardrails
🧩 Extract entities from a ToS document:
🧩 Generate bug-free Python code:
🧩 Use GPT to play valid chess moves:
1
2
37
🛤️
@pydantic
support in
@guardrails_ai
!!
If you want to fit some LLM output in a Pydantic model, Guardrails now supports:
✅ Automatic prompt engineering from pydantic model to try for a valid output
✅ Correcting LLM output by reasking GPT if needed
📚
1
7
37
500🌟 for
@guardrails_ai
on Github!!
Huge shoutout to community contributions by
@krandiash
@devenbhooshan
irgolic
@gneubig
@KyleRayKelley
@DevenNavani
@oliverbusk
@lakshyaag
@HighnessAlex
fruttasecca pkandarpa-cs
Also announcing the guardrails discord!
4
2
35
Crazy to see the same misconceptions about working in ML industry jobs over and over again.
I’ve worked in ML in tiny startups and in massive orgs, and have had research offers from top industry ML labs. I can confirm — you do NOT need a PhD to work in ML. (contd.)
3
1
35
A big lesson for me has been about how essential good UX is. Added this small UX upgrade for installing a guardrail in the latest release (before and after below)
This was a tiiiny change (took ~1 hr) among bigger ones in the release, but it makes me happy every time i see it!
0
1
33
Can't believe 600+ people signed up for my lesson on Maven about building reliable AI applications! Last call for signing up at 🔗 below for the course tomorrow!
2
3
34
closing out the week with a very special announcement
we're thrilled to launch
@bespokelabsai
's SOTA Hallucination detection model Minicheck-7B on Guardrails Hub
there's a lot of noise about hallucinations, but Bespoke comes with receipts (i.e. benchmarks)
1
6
32
Interesting observation from interviewing ML eng candidates at guardrails -- kind of wild to see how little consolidation there is around what different ML job titles mean
E.g. I was last on the job market 3+ years ago, and realized pretty quickly that for different companies I
5
2
33
🤩🤩
Learned about
@ShreyaR
’s awesome work on
@guardrails_ai
last week thanks to
@hwchase17
tweets and saw her IRL presenting at AI Tinkerers meetup tonight.
Can’t beat Twitter + SF for
#AI
these days.
0
0
7
1
1
33
You can now use
@guardrails_ai
to validate LLM outputs in
@gpt_index
! Big thanks to
@jerryjliu0
and
@disiok
for their speedy work on getting this in!
0
3
32
This is an amazing team with a lot of exciting problems to work on.
Source: Me
1
1
30
I had a fantastic time chatting with
@labenz
about practical strategies for adding Guardrails to LLM applications at the Cognitive Revolution podcast!
Check out my episode below 👇
[new episode]
@labenz
talks to
@ShreyaR
, creator of
@guardrails_ai
.
Shreya reinforces just how early we are in LLMs' impact on software.
In this ep they discuss:
- paradigm shift could unlock bigger productivity gains & user value
- risks of delegating output validation
1
3
12
1
2
29
@OpenAI
's function calling is a HUGE utility for developers! 💥
@guardrails_ai
's latest release supports easy JSON generation, validation and correction using function calling
1️⃣ Create a
@pydantic
basemodel of the JSON schema
2️⃣ Set up `Guard`
3️⃣ Call OpenAI's freshest model
4
5
29
Had a blast chatting with
@FanaHOVA
and
@swyx
about how to build Guardrails for AI for the Latent Space podcast!
Check out the episode below👇
🤖 If you're also building products powered by AI, you've seen first hand how unruly they can be.
@ShreyaR
is building
@guardrails_ai
to solve that:
- Enforce structure of outputs
- Validate correctness with "contracts"
- ReAsk and correct if needed
1
4
30
3
3
29
Amazing community contribution
@guardrails_ai
: you can now add a ✨translation quality✨ guardrail to generated text!
Huge shoutout to
@gneubig
🙌
Below, the raw GPT-3 output which is a poor translation, and the output by
@guardrails_ai
which filters low quality translations!
1
2
29
If you haven’t already, check out my conversation with the prolific
@mattturck
on the MAD podcast!
We dig our heels into a lot of relevant topics for GenAI builders — how to measure and mitigate hallucinations, patterns for GenAI systems, etc
1
3
19
🛤️ New
@guardrails_ai
release out! `pip install guardrails-ai==0.1.3` for:
🌟 New text validators `is-profanity-free` and `is-high-quality-translation`
🌟 Support for ChatGPT(!!)
🌟 Ability to configure max reasks *per query*
🌟 Bug fixes for
@LangChainAI
🤝
@guardrails_ai
2
1
27
Awesome new package for scraping web pages with natural language that uses
@guardrails_ai
. Check it out! 🔥🔥
Made a python Package for scraping webpages in Natural language. Special thanks to
@jerryjliu0
for gptindex and
@ShreyaR
for guardrails.
0
2
11
0
1
28
The
@guardrails_ai
discord just hit 100 members! 🥳
If you aren’t on the discord and are building LLM apps, here’s the invite link:
0
3
26
Listening to Random Access Memories all day. Daft Punk got me through multiple 16 hour flights to India and back, gonna miss them 😔
0
1
26
For real South Indian filter coffee is the best coffee out there
5
0
25
This is awesome! 🤩
Check out this demo of PDFs ➡️ tabular data using
@guardrails_ai
The past two days I've been working on using
@LangChainAI
and
@guardrails_ai
to extract tabular data from PDFs. Going to open source the codebase on GitHub this weekend. Excited to see what improvements are made from contributors!
12
22
138
1
2
25
ICYMI: excellent thread on the implementation details behind AutoPR!
AutoPR automatically creates pull requests from issues, figuring out files to edit, diffs, etc. automatically
In the 🧵,
@IrgolicR
shares how he uses
@guardrails_ai
to check correctness of AutoPR’s actions👇
What an amazing response to AutoPR's Twitter debut, thanks everyone! ❤️🎉
Let's dive deeper into the technical details of how AutoPR works 🧠
👇
1
2
5
2
2
25
At the heart of guardrails is RAIL, a language-agnostic spec that lets developers specify what a good LLM output looks like.
RAIL specifies structure + output validation, manages prompts and can contain custom code for validation, corrective action, etc.
2
3
24
always a mind***k when I remember that r/place and wordle were created by the same dude
0
4
24
Just goes to show the value of ML models-as-a-service!
Imagine a world where all ML model advances have an inference API that allows users to build cool apps like this. Takes away the burden of reproducibility from the user, and saves hours/$$ training a new model from scratch.
This is mind blowing.
With GPT-3, I built a layout generator where you just describe any layout you want, and it generates the JSX code for you.
W H A T
644
10K
39K
1
3
23
🛤️ New
@guardrails_ai
release out!
✅Better logging support — optionally persist logs to disk
✅Manifest embeddings (with caching) by
@laurel_orr1
✅More guardrails to validate generated summaries
✅A ton of bug fixes!
Try it out with “pip install guardrails-ai”
0
5
21
I've had a chance to play around with the Sonic model and have been super impressed by not just the quality but also the latency.
Take the model for a spin at 🚀
Today, we’re excited to release the first step in our mission to build real time multimodal intelligence for every device: Sonic, a blazing fast (🚀 135ms model latency), lifelike generative voice model and API.
Read and try Sonic
43
164
821
0
1
22
🙌 Guardrails AI got its first community contribution!!
Huge shoutout to
@devenbhooshan
for adding a tutorial on using guardrails to filter out profanity from translated text.
The example uses RAIL to create a custom validator for profanity filtering
Excited to release ✨Guardrails AI✨— an open-source package to add SLAs for LLM outputs!
Guardrails supports
🌟 pydantic-style validation of LLM outputs
🌟 corrective actions (e.g. reasking LLM) when needed
🌟 structure and type guarantees (e.g. JSON)
31
115
760
1
0
22
(1/2) I love this thread!
As an ML engineer in industry, a lot of my work is exploratory, so the tendency is to not merge code often. Isolating parts of your code that would be useful to your org (ie merge-able), is hard but rewarding. Code review is a great learning experience!
I've been thinking a lot about research and engineering and what they can learn from one another.
After grad school I spent 1.5 years working as a backend developer. Here's a list of some engineering lessons I picked up that have greatly improved my research productivity💪:
4
38
168
1
1
22
This is 🔥🔥
@justinliang1020
uses
@guardrails_ai
to query the OpenAPI spec of ChatGPT plugins in a structured way, making sure that the queries are valid for any plugin!
I couldn't wait for the ChatGPT Plugins waitlist.
So, I built a quick chatbot that can access any official ChatGPT Plugins by dynamically parsing their OpenAPI spec.⚡️
Built using and
@guardrails_ai
.
Link:
8
44
340
0
1
21
This honestly doesn’t get the attention it deserves. The process is so poorly designed that you are:
- capped at 10 attempts before you’re locked out for 3 days, and
- so flaky that you need multiple retries because of errors.
Thread:
I live in the US on a work visa. I’m among thousands of Indians unable to see their families because US consulates in India haven’t fully functioned through the pandemic. If I leave the US to see my parents, I won’t be able to return unless I get a consular appointment.
265
2K
9K
2
1
18
Had a fantastic time chatting with Charlie and Badar at
@mlsecops
on how to make LLMs safer and more usable in practical applications with
@guardrails_ai
.
Check out the podcast below! 📣
New MLSecOps Podcast episode is live! 🎙“Navigating the Challenges of LLMs: Guardrails to the Rescue ” with guest
@ShreyaR
, creator of
@guardrails_ai
is available now. 🎧
Listen or read here:
#MLSecOps
#aisecurity
#machinelearning
#genai
#llm
1
1
3
0
3
20
looking at
@sharifshameem
’s tweets every morning about new stuff GPT-3 can do — is this what new parents feel like when their child is learning to walk?
1
0
19
Meerkat is awesome! If you’ve ever felt the pain of trying to do data wrangling on unstructured data, you’ll know that existing tools are severely lacking.
As with all ML/data science apps, you need to be able to see and feel your data for it to be useful
We built an interactive data frame powered by foundation models that can wrangle your unstructured data (images, videos, text docs...)
Introducing 🔮 Meerkat!
📃
💻
🌐
3
60
206
1
2
19
Here's the specific job posting for the Santa Clara Valley location, from which candidates will be matched to our team.
3
3
18