Lessons learned from building my company's GenAI platform, a thread: 1. Be Flexible: Nobody can have a 12-month roadmap for their GenAI platform right now, because nobody (except maybe @sama) has any idea what’s going to happen in this space in 12 months.

@chicfryrice @DaveShapi It’s not a cure, but IDx-DR is FDA approved and improving the early detection of diabetic retinopathy. So there are already concrete advances from machine learning in healthcare

@mblayman And Angular was the gross “old” thing

Just tried this and it’s absolutely fascinating

@AdamRodmanMD @RichardAFerraro @huggingface I think that self-hosted chat + OpenAI-compatible LLM gateway is the way to go for flexibility and data control

@AdamRodmanMD @RichardAFerraro At my work we’re addressing this by self hosting an open source chat UI on top of LLM APIs that we already have BAAs with. In my experience it’s easier to get BAAs for the APIs than for end-to-end chat products.

I’m realizing that maybe the reason I’m seeing so many “you don’t need RAG” posts is because people thought it was for talking to a single PDF? Which admittedly is what a lot of the intros/demos show.

This ended up closer than I expected

@xlr8harder I’ve discovered that the Slack integration for Google Calendar does “1 minute before” and it’s beautiful

@alanzabihi No fair!

@alanzabihi @pelaseyed What I’m saying is that the academic article is an example of a take on RAG that is more nuanced and more accurate. Your blog post is less nuanced and less accurate. Maybe that’s what you were going for: blogs are a different genre, and you’re optimizing for marketing.

All new RAG variations must be submitted to me for naming approval. (Honestly this isn’t a bad idea, there are way too many different kinds of “RAG” proliferating)

It’s wild to me that there’s already marketing power in bashing RAG. Like, how long has “traditional” RAG been around? Certainly not enough to be called traditional

@pelaseyed @alanzabihi If you want to use exaggerated rhetoric for marketing purposes that’s fine, but then expect to get some critique of how much you’re exaggerating things for your own purposes

@pelaseyed @alanzabihi lol you say I’m trolling and then you pivot the argument. do either of you really think that 0% of the community agrees that RAG can mean something other than vector search?