I post about projects I'm working on and what I've learned • Engineer • AI, LLMs & Robotics • BJJ
@digitsu_bjj
• Ask a self defense, mma or jiu jitsu question👇
Seeing people you look up to reposting your work and following you on
@x
is really inspiring and motivating
Thank you guys
@pmarca
@amasad
Now back to building...
One thing I've learned and applied from
@hubermanlab
podcast is the importance of seeing direct sunlight as soon as possible after waking.
Even on weekends!
It has drastically improved my energy and sleep which ultimately improves my motivation and mental clarity.
Using the
@LangChainAI
expression language to compose a RAG chain with sources in ~75 lines of code.
Say you have a JSON file with a list of JSON objects.
Each object has a descriptions and source key.
Explanation of code and Github 🧵 ↓
📰 Seeing a lot of news about the language model, Falcon-40B so I decided to take a look.
📣 Getting started with
@TIIuae
's Falcon LLMs with
@LangChainAI
👨💻 Starter code, example and more. Lets Go! ⤵️
I've been messing with
@OpenAI
GPT4-V and object detection.
Over the weekend, I included instructor by
@jxnlco
• cleaner prompt
• can test other prompts quickly
• predictable data extraction
All leveraging
@pydantic
Explanation, detect fire, github and more ⬇️
Updates to Instagraph - now built w/
@nextjs
and
@FastAPI
- used instructor by
@jxnlco
to get nodes and edges
- added streaming of
@pydantic
models to client
- updated backend to
@render
Demo, links, code and more ↓ 🧵
I have a simple Conversational Retrieval Chain with a Vectorstore of 6,108 indices.
What are some techniques to speed up Q/A on Documents with
@LangChainAI
?
If you have a suggestions, would love to hear them below ⤵️
I'll also include any of my findings 🤔
📝
@LangChainAI
RetrievalQA lets you ask your documents (embeddings) questions.
Modifying the search for the retriever can increase the quality of your response.
Here is an example using
@activeloopai
's Deep Lake as your vectorstore.
Diagram, Code, and More. Lets Go! ⤵️
Converted a 30 minute voice note to text with whisper - then used
@jxnlco
instructor library to grab:
- summary
- keys points
- action items
- questions that needed answers
I would like to create an agent that could help me build an app based on a library that has some bad docs.
I'm thinking I could feed the agent the library, the docs, example projects and then ask questions.
Is this just a "chat with ___" or are people doing this other ways?
This is the first time I’ve ever made a video like this.
Really had to get out of my comfort zone 😂
Would love your feedback on the idea and my video 😆
cc
@_buildspace
@_nightsweekends
Inspired by
@yoheinakajima
Instagraph - I decided to make...
💥 Instagraph in Next JS
- Examples on Elon Musk, Venture Capital, ML/AI and Spanish
- Why I made this?
- Video and more ⬇️
There's been a lot of "Chat with a ___" built with LangChain/Streamlit. They're great intros to LangChain and help you build something powerful.
BUT I promise... this is better:
🥁 "Chat with" a Text File built with
@LangChainAI
and
@chainlit_io
Video, Code and More⬇️
🖼️🪄 INTRODUCING:
Distracted Boyfriend AI Meme Generator
Again... inspired by
@pwang_szn
's: Drake Bling Bakery
1. 👨💻Type in any topic
2. 🧑🎨Generate meme w/ AI using
@OpenAI
,
@LangChainAI
and
@imgflip
Demo, Code explained, Memes & Github link↓
@bhgsks
@LangChainAI
OpenAI has made it super cheap but if you'd like a free option I believe you could find something on
@huggingface
Take a look here:
🤖 Chatbot for
@viamrobotics
using
@LangChainAI
and
@OpenAI
I had been wanting to get back into robotics!
I thought it would be cool if I had an assistant that could help answer my questions while building my robot with Viam.
Demo, Code Explained, Github Link and More ⬇️
Toy Update:
Drag and drop components to get an idea of robots you can build and generate some predefined code for you.
What do you think?
cc
@_buildspace
@_nightsweekends
It was time to upgrade to
@Replit
core.
I've been using Replit for the past 4 years to teach my Python class. It's been helpful for sharing coding assignments and pair programming.
And recently its been my go to tool to write quick scripts.
Replit Teams brings the power of collaboration and AI to your workplace.
Join the beta waitlist today to be one of the first to go from idea to software, fast, alongside your teammates at work.
Your choice of embedding model significantly impacts the quality of retrieval for your RAG app
@LangChainAI
- is one of the most helpful RAG apps I've used
Going through the source code you see they are using
@Voyage_AI_
by
@tengyuma
to embed their docs
📣 Excited to launch: Ask AI your BJJ & grappling questions
@digitsu_bjj
• detailed responses with high quality video sources
• videos are linked to courses so you can explore other options & moves
• join a jiu jitsu community & learn with others
🔗 ↓
Wire framing a MVP for
@_buildspace
@_nightsweekends
using
@excalidraw
Highly recommend using excalidraw to wireframe or map out ideas quickly
DM or comment below if you need help figuring out a toy/MVP before your week 2 update
Here is an example using Falcon-7B-instruct with LangChain in < 15 lines of code. The instruct models are the chat format, ready to use versions of the models.
👀 Interesting answer from the LLM
Made a really quick landing page with
@TallyForms
and connected my custom domain
Only 5 weeks left of
@_buildspace
@_nightsweekends
S4 so using tools like Tally let me push something out there quickly so I can get feedback and focus on next steps.
This took me a while! I noticed how difficult it was to take this out of my head and simplify it in a few lines.
A Robotics and AI Bootcamp 👇
Would love everyones feedback!
cc
@_buildspace
@_nightsweekends
@FarzaTV
Here is a simple toy I started working on to learn more about sensors and actuators for my Robotics and AI Bootcamp
Check it out and let me know what you think!
Recommend watching at 1.5-2x speed 😅
cc
@_buildspace
@_nightsweekends
@FarzaTV
Good video explaining the
@LangChainAI
expression language by
@jamescalam
↓
Highly suggest understanding LCELs on a lower level before attempting to create or update your own chains
My journey to Engineering/Robotics started by competing in
@FRCTeams
.
One thing I learned about myself then and still applies:
You learn a lot quickly by having a task or goal you are working towards - and a curiosity, interest and excitement to figure out how to get there.
My experience today with Robotics simulators:
I spent a lot of my day digging into Gazebo, Webots, Unity, Unreal, Nvidia Isaac Sim and other platforms I could use to run simulation.
At the EOD I concluded that they all feels clunky, hard to get started with and not as
@FounderUni
Hey everyone, my name is Waseem! I am building A Robotics and AI Bootcamp.
A project-based robotics bootcamp, that teaches engineering theory while gaining hands on experience by actually building something.
Look forward to connecting!
Used
@yoheinakajima
Instagraph on Elon Musk's wiki page.
Viewing information like this when you are trying to learn or understand something is super helpful.
@AndrewYNg
Hey Andrew 👋. I'm finding this stuff fascinating. What is the difference between a Large Vision Model vs GPT4-V or LLaVA (Large Language and Vision Assistant)?
Get started with robotics, even if you don't have a robot at home 😎
@viamrobotics
- Reserve a rover 🤖
- Move the robot with your keyboard while sipping on a refreshing beverage at home🧃
- Copy/run some example code👩💻
How to get started ⬇️
Updated an old robot project from 2017 - tested it on a simulator and it works!
🤖Controlling a Pioneer 3DX robot with a 🕹️PS3 Controller using
@rosorg
by
@OpenRoboticsOrg
Github and more ⬇️
For anyone coding a toy
@_buildspace
@_nightsweekends
and using NextJS ...
highly recommend adding analytics to your app asap with
@vercel
its super helpful to see some basic analytics on page views and where its coming from
analytics can help determine your next steps!
Updating my AI knowledge graph generator
- Using instructor by
@jxnlco
I can add more details in the docstring and the field descriptions when prompting for better results
- Added streaming - thanks for the help
@samuel_colvin
on SSE and
@FastAPI
All powered by
@pydantic
I love Python ... but the NextJS/Vercel/FE ecosystem and community helps you ship powerful things ... fast
Built in a few hours with:
-
@shadcn
ui lib/template
-
@nextjs
-
@reactflowdev
-
@OpenAI
- Flask
- And piggybacking off
@yoheinakajima
og repo ⬇️
📢 Neutron School - A Robotics and AI Bootcamp!
Project based hands-on approach to learning that is more effective than theoretical study alone
Become a well rounded engineer, do better in school/ work, build cool shit
Sign up - link in bio!
cc
@_buildspace
@_nightsweekends
So this was unexpected…
Well… back to the drawing board
Time to clean up my technique by watching some
@digitsu_bjj
videos 😆
Launching something bjj related soon 👀
#bjjtwitter
#bjj
@levelsio
Not sure but just wanted to add here that Istanbul was the most amazing places I’ve visited.
The mix of old and new culture, architecture and art. The food was amazing. The people were really nice.
Highly recommend!
I did this on another platform and met some cool people
There seems to be a decent community of people in tech that are also interested in jiu jitsu 🥋
Comment below anyone you know ⤵️
Repost to spread the word 🔃
"Pydantic is all you need"
Just finished watching
@jxnlco
talk at
@aiDotEngineer
summit
Planning to update instagraph-nextjs to use Instructor and Pydantic 🤓
Knowledge graph of Jiu Jitsu 👇
Just met up with
@jxnlco
Had a great conversation about:
- LLMs and software
- selling a knife and not a slap chop
- pottery making, free diving and Jiu Jitsu
Appreciate speaking with smart people
@AdamMGrant
Any advice on how to deal with these kinds of people. And ultimately avoid them.
I’ve been in a situation working with someone like this. It felt so draining.
It was hard to feel like you had a voice.
And I think I’m still trying to recover from it.
I never do throw back Thursdays but this deserved it
The first robot I worked on was for
Rebound Rumble
@FRCTeams
@FIRSTweets
2012 competition
I had no clue what I was doing and where this was going to take me
Thanks
@szainule
for the opportunity
#TBT
DC is pretty cool. I would definitely consider living there. On the train back to NY reading, Progressive Capitalism by
@RoKhanna
.
Thinking about how fortunate I am that my parents came to the states in search of a better life.
Hope I can give back to the future generation.
4 Habits to Being a More Efficient Learner by
@thejohnfish
1. Create a distraction free environment
2. Be an active note taker and learner
3. Prioritize your health
4. Revise your knowledge actively
Really nice that with a quick script I can upload docs/urls and create an agent in using their Python SDK and test QA right from the dashboard
Here I am uploading a Deep Learning textbook
thanks
@pelaseyed
@alanzabihi
Interested in building your own satellite?🤔
Another example of how you can learn anything from the internet.
Check out:
@quetzal1_uvg
open sourced Guatemala’s first satellite. You can find design docs, software etc.
To really leverage Falcon-40B it should be fine tuned for your use case.
Going to be messing around with it more in the upcoming month. More coming soon!
BTW Falcon is a pretty bad ass name
@TIIuae
2nd Place: CVU (CV site Generator) by Marija Josifovska and
@waseemhnyc
Upload a LinkedIn profile, and generate a beautiful resume site that you can deploy with
@vercel
Link: Coming soon! People were already asking to pay for this after the presentation so you don't want to
Who’s doing
@_nightsweekends
@_buildspace
S4 in NYC?
@AishaOmmaya
and I are planning a meet up and want to get a head count of who is down.
👋 below if you're in and retweet to spread the word 🧑🤝🧑
To all the humans building robots with ROS!
How did you go about learning ROS?
Personally I went to the
@rosorg
@OpenRoboticsOrg
website, followed their docs, and worked on a project. Later on I learnt more in a mobile robotics class.
How about you? ⬇️
I've drastically cut down jiu jitsu since the start of the year
Using the extra energy for building
Planning on releasing a new project soon
Keep a 👁️ out
In my quest to learn and build robots faster with Viam I created:
💬 Chat with
@viamrobotics
docs 📜
Built with
@LangChainAI
@OpenAI
@nextjs
Demo, details, link to ask your questions and more ⬇️ 🧵
🖼️ INTRODUCING: "This is Fine" AI Meme Generator
1. ⌨️ Type in any topic - FE built with
@chainlit_io
2. 💬 Create meme text with
@OpenAI
/
@LangChainAI
3. 🖼️ Send over text to
@imgflip
to generate meme
Demo, Code, Github link and Memes ↓
@elonmusk
Guyana is a small country north of the Amazon that is primed to receive the economic and social benefits of Starlink.
With the discovery of its oil reserves, an influx of funds have boosted the economy. While the new money is great (a large percent is taken Exxon), enhancing
Off to midday BJJ
Today I'll be working on transitioning from triangle chokes.
According to instagraph (link in bio), if the choke is failing, I can:
- try another submission: armbar or omoplata
- transition to another position: take the back or sweep to mount
#BJJ
#MMA
First day of class
@_buildspace
@_nightsweekends
S4
39 days left before demo day
Plan on
- ironing out my idea
- deciding a rough schedule for the next 39 days
- pick a name
- buy a domain
and keep the ball rolling...
Updated:
🥁 "Chat with" a Text, PDF, HTML or CSV File with chat history
Made with
@LangChainAI
and
@chainlit_io
Demo with my parking ticket receipt 😅
Why Chainlit, Code and More ⤵️
Build your robots, smart machines and any hardware related projects faster with
@viamrobotics
code snippets 🤖 ↓
Updates:
- included Power Sensor and Generic component for Python 🐍
- added Golang snippets 💥❗
Works with
@code
and
@cursor_ai
🌐 InstaGraph NextJS Update - Give it a try! Link below.
Added the ability to save your knowledge graphs!
Video, examples, github and
@yoheinakajima
original project 👇
"Command + F" in ARC by
@browsercompany
- lets you:
• find something on a page (like every other browser)
• ask questions about the page
This is really intuitive.
It feels like the correct way we should be chatting with docs, pages and other data.
In like < 5 minutes I created this movable 3D object with
@threejs
with the help of
@OpenAI
Its not exactly what I want - but its a really easy way to get a template to start from
Happy Friday!
Wanna leave this week on a 💥
Adding more to my “toy” and posting about it before EOD
Have a good day! Let’s get after it relentlessly
cc
@_buildspace
@_nightsweekends
Ramadan is right around the corner. First few days without caffeine and water is tough. But afterwards my brain feels like it has super powers.
I would highly recommend that everyone tries some kind of fasting.