Lucy Farnik
@lucyfarnik
Followers
734
Following
1K
Statuses
427
Feeling the AGI. PhDing. Poking spherical cows with a stick. DMs open!
London, UK
Joined March 2022
Great to see so much discussion of our recent paper! Leo's take here is likely true. Our paper basically says "SAEs + quantitative autointerp = dead salmon". That doesn't imply "SAEs = dead salmon". Some people on Twitter seem to be overupdating on this paper
@aidanprattewart @ThomasEHeap @tslwn @lucyfarnik @laurence_ai always good to get skeptical takes on SAEs, though imo this result is because of problems with SAE evaluation methodology. I would strongly bet that well trained SAE features on random nets are qualitatively much worse than ones on real LMs.
2
7
72
Lol, the planning system was blocking a dam construction for 7 years, so some beavers just took matters into their own paws and built it overnight
A colony of 8 beavers in the Czech Republic have completed a dam project in two days, something local officials had been planning for the past 7 years.
0
0
3
@tomaspueyo I don’t think drawing an exponential based on one datapoint which breaks the previously linear trend really works
0
0
1
Interesting-looking paper for mech interp! You can just swap a few adjacent layers in an LLM around and it barely affects performance. (Only skimmed it so far though)
1
0
4
@GoogleDeepMind @deepseek_ai To their credit, @OpenAI's newer reasoning models do refuse. But GPT-4o is still basically helpful-only.
0
0
1
RT @calebwatney: OpenAI is threatening to trigger their vaunted "AGI Achieved" loophole mostly to get out of the Microsoft contract and hav…
0
258
0
Lol, I just asked o3-mini-high "I wanna do X, i suggested equation A but my supervisor says we should use equation B, why" I then opened a new chat and asked the same thing with A and B flipped In both it gave a mathematically convincing explanation why my supervisor was right
2
0
29
RT @m_ashcroft: @mhclg Please consider what negative effects this legislation could have on those not in traditional employment, who may fa…
0
1
0
RT @norabelrose: MLPs and GLUs are hard to interpret, but they make up most transformer parameters. Linear and quadratic functions are eas…
0
32
0
@schwarzposter_ Here's why Also, I'm not upper-middle class. If I was, I could presumably just buy a house so this wouldn't affect me
Well-intentioned yet terrible policy from @mtpennycook and others Entrepreneurial people like me don't have easy ways of proving income to landlords. The only way I can get tenancies is offering rent upfront This will discourage innovation; it fails @Keir_Starmer's Growth Test
0
0
2
@10DowningStreet @Keir_Starmer The media must hold them to account for this terrible policy that ditches their pledges @szupingc @shinychris @tweetsbyames @PickardJE @GeorgeWParker @Sam1Fleming @hilaryosborne @RJPartington @BenChu_ @DavidSamFrancis @EdConwaySky @ConnorGillies
0
0
0
Despite some of my disagreements with @Conservatives @KemiBadenoch, I don't think a policy this disastrous would've happened under a Tory government Yet another consequence of @UKLabour not knowing what it's like to start a business
Do I think the Government will do better than the market? No. If the Government wants to help insecure renters, reduce their costs! Give them money or stop blocking housing.
0
0
0
@NathanpmYoung Labour's policy platform on house building is I think surprisingly good, but this particular proposal is just misguided nonsense. It privileges those in traditional employment, leaving entrepreneurs in the dust
0
0
1
@mhclg This is a terrible idea, anyone entrepreneurial who doesn't have easily provable income will struggle to find a home. Offering rent in advance is the only way people like me can secure tenancies; this will create a massive disincentive to innovation and growth.
0
1
10