Jungle
#19
. Fullstack Software Engineer. Writer of The Bit Shift. Making you more productive to focus on what really matters. Click here👇(DM me to consult)
Here’s my entire series on Local AI starting from scratch 🤖
Going from nothing to running Ollama, having code suggestions in VS Code, Accessing your Local AI while Remote, and how to build a hardware setup for Local AI.
Running AI Locally and Privately for Free
@NewRightPoast
Catch22 on videos like this is that you have to record everything and edit and publish it to social media
That sort of mindset is naturally unhealthy and self centered since you’re seeking validation on social media, which conflicts with the “I’m happy” tone of the video
@BowTiedBull
called out almost 1.5 years ago making a list of over levered AirBnB hosts who will sell with pandemic issues.
Delayed due to moratoriums, but a house I’ve been watching for that time just went onto the market. Great call from Bull.
It was this moment less than a year ago I decided not to associate with a certain member of the jungle.
I felt they were a narcissist, had no moral boundaries (in info sec too 😱), a con man, and a huckster.
They damaged the bowtied brand more so than anyone else here.
> lies on resume about college experience
> cyber person who knows nothing gets access to critical system
> company hacked, massive liabilities
> Legal finds out you lied
> sued into oblivion
> Jailed
My sides
Every. Second. Of this.
I have never seen a cyclist-driver confrontation like this before. And towards the end it seems to jump the shark completely.
Thank-you
@MikeyCycling
for sharing ... more details here
> lies on resume about college experience
> cyber person who knows nothing gets access to critical system
> company hacked, massive liabilities
> Legal finds out you lied
> sued into oblivion
> Jailed
My sides
I spent all weekend learning about GPU hardware for running local AI and I have some interesting takeaways.
1. 24 GB GPU cards are the sweet spot of scaling out, this means 3090, 4090, P40 in the nvidia line
2. Apple's move to unified memory looks prescient now. 5K get's you a
Fair to say I finally have my first side hustle now doing freelance software work. Two jobs done for the members of the Jungle. $350 made for the month of June. Really happy how this has all worked out.
It's so easy for men to slip into a feeling of no purpose and emptiness
This is why we need to build and craft. We create to build upon our souls and fulfill that void.
Starting a loving family, working on the car, writing software. These activities fulfill ourselves.
Almost violated my integrity last night, feel sick about it still. But I’m glad I made the right decision.
It’s hard to stick by your beliefs but it’s worth it.
@dhh
Reality is you just need to get the product out first.
Once you have ten million users you’ll also have the ten million users level of finances to fix the scaling
Switching to a Mac laptop has been a total net positive for my productivity
Virtual desktops with mac trackpad are elite
Insane battery life even with multiple browsers open
tons of high quality tools and apps
benefits of linux + brew
apple ecosystem is excellent
New paid article out on workstation optimization. A must read if you do software development!
Building an Optimal Software Development Environment - Part 1: Physical Layout
Fuck Microsoft
I only had a few non sensitive items but I never agreed to have my files exported to the cloud
Such a scummy company. I always go above and beyond to remove their dumbass bloat. There are 100% people getting hacked from this who are less cautious than me.
*MASSIVE SCAM WARNING*
If you are a user of Windows, then during system installation, you must have encountered the persistent OneDrive application.
If you lacked courage to immediately eliminate this 'cockroach', there's a high chance it may have copied some of your private
@twobitidiot
@ewarren
@JoeBiden
Democrats need to feel pain over this. The victory felt too fast. They need to suffer massive losses at the voting box over this issue.
Pain is a teaching and reinforcement mechanism. They have not felt enough.
Finally got VS Code Continue working with llama3 locally. As usual check the issue boards
Now I have an entire AI locally processing my code base, I can ask it questions in chat, and also get inline suggestions. Similar experience as Cursor but all on my own hardware and network
I'm [redacted] since I didn't know how easy it is to run LLMs locally now.
Install ollama
in terminal run `ollama run llama2`
You now have a local LLM in terminal
More private than Chat-GPT.
Now install coding based LLMs
????
Profit
Just spend a chuck on change on a new tailored suit with all the extras and I wasn’t even mad since the tailor /owner was the nicest and coolest guy.
Dude knows what he is doing. Made me feel good about spending money. Sales makes so much sense now.
As a software engineer these are the things you should look for in a job description
- strong Salary range
- continuous deployments
- low meetings culture
- strong innovation culture
- cloud based
- all encompassing benefits (PTO, medical, etc)
- growth focused company
- key
Two tools that have saved me countless hours.
1. Ad blockers that stop bloated http traffic and files from loading.
brave browser + unblock origin + adguard DNS blockers
2. Password manager to auto fill login forms
Never struggle to create or remember a password again.
@BowTiedKnoll
When he blatantly bought thousands of bot followers but had 0 interactions on his tweets I knew he was a fraud. He used that and fake accounts to start selling his boot camps.
Him being a POS to many OG jungle members who I knew were good dudes sealed it.
Running AI Locally and Privately for Free
Value your privacy? Run AI locally and don’t risk your sensitive data. It’s easy to setup and integrates with your code in IDE and many other apps! Avoid censorship and use customized models for your tasks
Repeat after me:
Programming languages are a means to an end. They do not deserve obsession or cults or single mindedness
Pick the right tool for the job. It’s not bad if you need to use a different tool to be more efficient in a context
Always understand the cost and benefits
Highly recommend some form of notetaking app + a summarization system to build a knowledge repository. Being able to tie info together and recall it gives you a second brain power.
Loqseq + Progressive Summarization + Zettelkasten = Super Brain
🚨 There is currently a compromised library going around in multiple Linux package managers
Please check for xz 5.6.1 and immediately downgrade
This looks like a multi year, nation state level effort to introduce a remote backdoor into all these operating systems.
Everything I
@suzanne_cummins
@BowTiedDVM
@BowTiedKong
@atrupar
Ah yes, the book that was taught to me under supervision of priests, and educated theologians and also consented with by my parents that has been studied for a thousand years.
This is why I will scream Local AI till I turn blue.
Microsoft is going to take all your data, offload to the cloud, perform big data operations and use AI to “help” you.
There will be minimal regard for privacy and your data can be used by the feds
Satya Nadella says Windows PCs will have a photographic memory feature called Recall that will remember and understand everything you do on your computer by taking constant screenshots
If you’re scared of deploying software it means you have:
1) a lack of testing coverage
2) the inability to rollback easily
3) a lack of monitoring
Fix all of these and you will be much saner
I have caved and started using chat gpt at work.
It makes me a better engineer to have a dialog and code samples provided to me, especially working in unfamiliar Territory.
Today I was doing a lot of reflection / meta programming in C# and it’s really verbose and particular to
Just realized that we can combine local hosted AI on our own hardware with a cloudflare private tunnel to get your own AI anywhere, in a secure manner.
Will write something up on this.
Personal and private AI, with self hosted models, all on your own private network, with
Now that I'm more of a senior dev I'm realizing I need to set the engineering culture
I need to be the change and I can't hope or wish it turns out well
So yes I'm going to hound you to cover requirements, ensure your tests pass, that you document things, and communicate well
Boss man not giving you a raise? Times are “tough” for the W2?
You can just work less hours. Congrats your hourly rate went up.
Make sure you fill that void with WiFi money
Sinple
Going from a full stack position to a backend position with some dev op has been such a great change for me personally
Front end code might be some of the most inefficient code that we have to write, even though it’s the most important user facing code
All competent software engineers need to use chat gpt
It is a massive catalyst, I can’t understate this.
It has allowed me to work in languages I’m not familiar with at a proficient level.
Python, php, and bash all are things I’ve written yet I’m nowhere near an expert in
You need to be terminal maxing.
You need to have a great font, you need to be oh-my-zsh-ing, you need to be iterm2-ing, you need to be m3 pro-ing, you need ligatures and powerline fonts.
So many great habits forming into routines thanks to the Jungle this year
Daily walks :
@BowTiedOx
Facial Cleansing :
@BowTiedFawn
Crypto Raiders :
@BowTiedNightOwl
Macro views :
@BowTiedBull
Plus more substacks, freelance opportunities
Forever thankful to the BowTiedJungle