Ok, today, I will be posting multiple videos of OpenAI GPT demos I built. All of them will be MIND BLOWINGLY GOOD. Because they are demos :)
But seriously, OpenAI is good for prototypes. Follow this thread if interested. At the med of the day I will do an analysis.
So OpenAi had already trained GPT-4 by the time they released ChatGPT?
So basically we have not had a better model(even by OpenAI) for the last 2 years?
UPDATE: Sam Altman finally responds to Helen Toner's revelations from our interview on The TED AI Show.
Here's what he had to say at the UN's 'AI for Good' Summit. Your thoughts?
@peeleraja
Dude. What a small world. I was the guy who sold you that coffee. Remember you didn't have change and I said it's ok as the elderly lady looked so humble.
Dear startup events, can we please have someone other than Paytm, Swiggy, Zomato,Ola and Oyo speakers. Its been ten years now. Please find new talent :-)
The working middle class is taxed heavily in the name of the farmer.
The farmer's lives have not improved one bit.
The politicians and the rich get richer.
Story of India in 3 sentences.
This is an Indian farmer .
His feet are bloodied from marching past 6 days from Nasik to Mumbai. One of 35,000.
#KisanLongMarch
( pics via
@FightAnand
)
Mapping this to our product built and managed in India:
Fixing a bug costs about $100-$200.
A small feature improvement costs about $400-$2,000. Shipping a major feature like product ratings costs $8,000-$15,000.
The rough cost behind shipping a product like Gumroad:
Fixing a bug costs about $1,000-$5,000.
A small feature improvement costs about $2,000-$8,000.
Shipping a major feature like product ratings costs $60,000-$100,000.
Forget politics. Forget everything else. I mean, how can you justify something like this. These are all mirrors which show how ugly we have become as a society. It is upto us to fix these wrongs. Atleast for our future generations.
Ram Rahim has been granted parole NINE times in the last 04 years. Two r
@pists
in the Bilkis Bano case got parole.
But GN Saibaba, a writer and professor of English with 90% disability, was not granted parole at the time of his mother's death. 10 years in prison.
New India !!
Letting GPT-3 do my presentations from now on. Just copy a bunch of text and let GPT-3 generate the presentation. Using Google slides scripting. I am not good at presentation skills. This is for proof of concept. So be gentle :).
cc
@gdb
This looks like fun. Since GPT-3 access is not public yet, I thought can we make something similar with what we have. I mean
@huggingface
,
@spacy_io
have made NLP easy and HTML and CSS has advanced so much. So I sat for a couple of hours and voila! No GPT-3 demo :)
This is mind blowing.
With GPT-3, I built a layout generator where you just describe any layout you want, and it generates the JSX code for you.
W H A T
Rupee is back at 68.
Petrol is at 80.
No congress bigwig is in jail yet. Not. A. Single. One.
Remind me again why we voted for BJP?
To the die hard BJP fans in my timeline, what are the core reasons to continue your support?
@championswimmer
And how is Astrophysics related in all of this?
Literally, the definition of Astrophysics says its the study of what heavenly bodies are not where they are.
James Keeler will be turning in his grave.
If you are an Indian B2B SaaS founder, a couple of pointers:
1. If you are looking for a $5-$10 million exit you may find it in 3 years. We have enough big startups within India itself which can buy you. But you have to be focused.
So it's 2019. Why not start the year with a tweet storm :)
Are you planning on building an India focused B2B startup in 2019? Few suggestions below:
1. It will not be VC fundable. So plan to bootstrap or get some Angel money.
2. First year concentrate on friendly accounts.
@nileshtrivedi
The problem is not Math. The problem is political. Look at the Asian representation. Even the few from Asia and non white representation most probably will have some white partner or affiliation.
Best way to improve would be a fields medal equivalent in India. With Indian judges.
@Teknium1
Not sure what is lol about it. It was certainly not public knowledge as can been seen from the response to the tweets. I distinctly remember OpenAI folks saying they were gonna start training on GPT4 after ChatGPT became successful. Ok, even if I missed that, the tweet still
They don't care anymore. Pune police has been caught with proof of planting evidence.Nothing changed. We can crib all we want, the simple fact is majority of Indians(even the well educated ones), are absolutely fine with the government trampling our rights(as long as it's "them")
I have had it with Indian VCs trying to apply their gyan to Indian SaaS startups
Afaik,no VC startup has figured out selling to Indian customers. So take gyan with a pinch of salt
I have a simple rule:
If gyan from founder,apply in ur startup
If gyan from VC,apply in ur pitchdeck
I did my part in the fight against corona. Yesterday I lit a candle at 8:37pm for 3 mins while standing on one leg so as to concentrate all my energies. Why 8:37? You see, 8+3+7=18. What is 18. It's 9+9. So it's double the effect.
But there some small disadvantages to this approach. Because relatively its so cheap to build stuff, a lot of Indian startups build unecessary features. US startups think a lot before building stuff. So advice for Indian startups:
Think before you build.Dont build and then think.
Traits of a successful Indian startup founder:
1. Raise loads of VC cash.
2. Use the cash to give discounts and show growth.
3. Raise more rounds.
4. Take large salary and secondary exit in one of those rounds.
5. Angel invest in other startups before you figure out your own shit
This is so true. Back in late 2011, early 2012, Sequoia had shown interest in us but then chose Knowlarity. With that funding, everyone assumed that they will run rough shod over all competition including us.
But capital is not a moat. We always believed we had the best product.
The last decade has taught us a singular lesson - capital is no moat but being able to build a viable business with whatever capital you have definitely is. I hope we all remember this in the next decade.
One of the first innovation we are doing is to rethink the age old process of IVR design. Make the boring IVR development exciting. Just tell the flow of your IVR in natural language and get a phone number with the IVR flow designed. Prepare to have your MIND BLOWN :)
cc
@gdb
Parents are paying 20 lakhs for their kid's education (1-10th standard). In some schools it becomes almost 70 lakhs.
None of these schools are giving great education. Most parents of these kids find tutors outside. No parent is happy.
How has no startup disrupted this yet?
@appadappajappa
They are the same people. Worked for money then. Work for money now. Only then, because they were spreading message of peace, we thought they were good people and they meant what they said.
Working backwards sometimes helps.
Aim to build a SaaS company valued at 100 crore.
This means you need to get to 10 crore ARR.
This means you need to get to 1 crore MRR.
This means you need 1000 customers who will pay you 10,000 per month. Or 10,000 who pay 1000. Who are they?
Wow. Its become really bad on Zomato and Swiggy delivery. Wanted to order dinner, same items:
Zomato:₹745
Swiggy:₹710
I was anyway going on tje way so dropped in at the restaurant.
Self delivery:₹490
The difference has become too much now.
Great start to the new financial year. Congrats to our sales team, they did not let go of an enterprise opportunity deal for two years and now we have added a $500,000 ARR customer.
Enterprise sales is a different beast.
Whatsapp has payments now.
So I guess the chain forwarding mails will come with an extra line.
After you see this image of Ganesha/Shirdi/insert a God here,forward this message to 10 people and donate ₹100 by clicking or bad luck will follow you.
@emerywells
@ylecun
No it is merely a knowledge database with no complex reasoning. It has failed India's JEE exam()
Most probably because those questions are not there in training.
So unless OpenAI releases the training dataset, it has to be assumed, its a knowledge DB only.
Was thinking about this because we just crossed the $1 million ARR in the US. Zero sales people. Only founders and core team was involved in the sales cycles. Will blog more about this later.
10 years after I wrote this, the phone call is still not dead :-)
And Twilio is a 5 billion company and we are still around.
Looking forward for the next 10 years :-)
Telugu LLM Labs
@ravithejads
and
@ramsri_goutham
in the house.
Surprised to find out that this is the first time they are meeting in person :)
Proof that great things can be done with just online collaboration.
Their model Navarasa 2.0 is a leading Indic model.
#AIdays2024
I went down the Hindi imposition rabbit hole. This is what I have learnt.
1. Hindi is not a classical language of India. Its one of the youngest. Its younger than all south Indian languages.
2. Among Indian languages it has the highest percentage of speakers.
When you see quotes about how great it is to live in India because you can have a maid, driver, dog walker, delivery people etc, just remember, this is the modern untouchability that these same people have to go through.
As a society we are programmed to hide our dark and dirty secrets and today we think the people who do our hard labour work cannot coexist in a same space as we are. Incase they are caught? Like it’s a crime? Fine of 1000? It’s probably 25% of most of their salary.
@DicksonPau
The tweet is not that we didn't know GPT-4 finished pre training in 2022. The tweet is that no better model has come out, better than GPT-4 since that time. 2 years. And no better model. So are the limits reached?
This checks out.
But once you:
Buy a house, you realise there is no dream home.
Travel enough, you realise there is no place like home.
Eat at restaurants enough, you realise home food is best.
Donate enough, you realise donating your time is more important than donating money.
The true value of money isn’t just in having lots of it, but in the freedom it gives us from constantly worrying about it. Money is a tool that can help us reach a point in life where we no longer have to stress about it with every choice we make.
I recently read a blog by
The Omega Files (Inaugural edition)
————————————————
It has taken over a dozen years to get here. I was hoping it would be done by year 10. And we still have a few years before the Final Chapters of the Blume Fund I journey are entirely closed.
The First Edition of The Omega
Giving a talk here on 30th. Going to rip apart myths of deep learning :-)
@GaryMarcus
I have used the title of your book as the title of my talk. Hope its ok. Trying to counter the myths and hype of deep learning in India.
Translation: I’m sitting in administration. I know, Rupee can’t fall at this rate. None of our neighbouring countries’ currencies are falling at this rate. Then what is the reason Indian Rupee is falling like this?
You have to answer. Nation is asking
Casually met a person at
#saasboomi
He introduced himself as the CEO of Devrev. Got talking. I was somewhat absent minded. Turns out, it was
@dheeraj
of Nutanix. Dude cheated me into thinking I was talking to some regular event hopper :)
Great to get connected and we'll do more.
@goodside
@random_walker
Been seeing that now its working much better with math equations. looks like they have augmented the LLM with code readers or calculators.
Enterprise sales is very hard for startups.
You might close the deal, but before the money hits your bank it might be 6 months.
Investing in an enterprise sales team takes lots of guts. And patience.
We did that. For 9 months no returns.
But when it starts paying off,it pours.
And they have the money to do Airforce flyovers and Helicopter petal drops.
India is like that startup where the core product does not get funds but the PR and marketing department gets all the funds.
I took this screengrab from a you tube video.
Indian flag flying high.
Thanks to Gomathi.
Just look at her shoes. Apparently one of her shoe was torn. No money for shoes.
In India you have to become successful inspite of the system.
But you are still proud to be an Indian.
VC funded model gets the most coverage in the startup ecosystem. So thought I will put some of my thoughts out there.
Success parameters vary for bootstrapped and VC funded startups.
For example you can happily run a $10 million run rate bootstrapped startup with 100 employees.
What about a "pure non veg" mode?
My preference is to not let the boxes from these "pure veg" restaurants in the delivery box meant for me.
Or what about a "pure vegan" mode. No animal products including milk based in my box. Thats more "pure".
You see where this is going?
Our dedicated Pure Veg Fleet will only serve orders from these pure veg restaurants. This means that a non-veg meal, or even a veg meal served by a non-veg restaurant will never go inside the green delivery box meant for our Pure Veg Fleet.
Proud of my team for pulling an all nighter to launch the first full featured cloud contact center integration with WhatsApp, within 24 hours of the WhatsApp business API announcement :-)
GPT-3 works, but needs a lot of hold holding. Just for research purpose, I fed the prompt as suggested by Guardian and following are some completions without cherry picking.
As you can see it needs to be hand held. I found that it needs direction every 4-5 sentences.
Shame on
@guardian
for cherry-picking, thereby misleading naive readers into thinking that
#GPT3
is more coherent than it actually is.
Will you be making available the raw output, that you edited?
I have been complaining on Twitter about how Telugu is not getting it's due. So I decided to channel that energy and make something out of it :)
The result is a Python tutorial for kids in Telugu.
The English version is here:
If you are hiring from BE colleges, the best way to get the best programmers is to just attend a programming practical session and sit for the three hours in the lab. You will know who are the 2-3 kids who actually program.
My advice to final year engineering students: explain your BE project to your grandmother. If you cannot, you haven't yet understood it completely yourself. When you can, you'll do well in your job interviews.
My prediction: in 2024 most companies will realise using LLMs(in their current form,either small or large models) to solve their problems is the most inefficient way of solving the problem and will choose better architectures.
Even now most companies use LLMs because of FOMO.
My prediction: in 2024, most companies will realize that smaller, cheaper, more specialized models make more sense for 99% of AI use-cases. The current market & usage is fooled by companies sponsoring the cost of training and running big models (especially with cloud incentives).
@ylecun
"Current LLMs are pretty close to the "retrieval" end of the spectrum." is the perfect analysis of LLMs.
In most of my experiments we have seen that a basic kNN is enough.
Maybe it's not "Attention is all you need". Most probably it's "kNN is all you need"
I will not link my Aadhaar to my voter ID. If I lose my voting rights because of it, so be it. Thats a different fight I will fight based on how much time and resources I have.
Govt is distributing pamphlets asking us to link Aadhaar to voter IDs. There was no information provided on whether this is voluntary or mandatory. We were told to return filled forms on Monday, compulsorily. The officers in charge need to clarify this while distributing, i feel
If you gun down civilians, you are a terrorist.
If you bomb buildings you are a terrorist.
If you hold people hostage, you are a terrorist.
If you value land/religion more than people, you are a terrorist.
Now guess which side I am talking about.
There in lies the problem.
7. You will need to invest in a direct sales team.
8. It's a long game. At least 7 years.
9. There will be an upper limit on the market size. It maybe 20 million or 100 million. Plan accordingly.
10. Plan upsells.
Most importantly in India every startup sells one thing, TRUST.
I made a fully functioning movie search engine on top of GPT3.
Ask it anything, it returns the exact answer AND the corresponding URL from IMDB(gets it right 60%-70% of time).
It's🤯AWESOME. I mean "Father of Luke?" Really :)
cc:
@gdb
@npew
@gwern
And here in lies the next big advantage for Indian startups. Build in India and sell in the US. The development cost arbitrage is too huge. An US startup will take 10x more amount to build a feature. Or fix things. Its not scalable.