Tobias Mann Profile Banner
Tobias Mann Profile
Tobias Mann

@Tobias_Writes

Followers
1,123
Following
624
Media
475
Statuses
3,058

Systems Editor @TheRegister / @SitPub — hiker, animal lover, photographer, blogger, and tech journo. I'm over on Mastodon now at @tobiaswrites @mastodon .world

Denver, CO
Joined June 2017
Don't wanna be here? Send us removal request.
Explore trending content on Musk Viewer
@Tobias_Writes
Tobias Mann
7 months
This one rack is 120kW of compute. Let that sink in.
Tweet media one
127
164
1K
@Tobias_Writes
Tobias Mann
7 months
Here's a closer look at Nvidia's "bring up board" for the 2.7kW GB200 that Jensen showed of on stage yesterday. Notice this one has the power phases around the Blackwell GPUs. #GTC24
Tweet media one
4
46
254
@Tobias_Writes
Tobias Mann
7 months
@echo5juliet No. All liquid cooled. Hot Isle would be brutal otherwise
5
0
115
@Tobias_Writes
Tobias Mann
7 months
It might not be a dinner plate of silicon like Cerebras's WSE-3, but Nvidia's GB200 Superchip certainly ain't small. #Nvidia #GTC24
Tweet media one
3
15
82
@Tobias_Writes
Tobias Mann
2 years
Wait, @amazon built a mesh network out of Echos and Ring doorbells? And now developers can tap into it? Imma be honest, I find that more than a little creepy. Check out my breakdown @TheRegister #mesh #networking #smarthome #IoT
7
32
64
@Tobias_Writes
Tobias Mann
3 years
Today marks the end of a journey and a bittersweet one at that. It's my last day as an editor @sdxcentral . But rest assured, my days of covering tech are anything but over. Stay tuned for more on my plans in the coming days. Trust me, you won't want to miss it.
13
0
64
@Tobias_Writes
Tobias Mann
7 months
@GModenezi DC bus bar. Tons of NVLink copper interconnects vaguely visible, and of course the water cooling rack manifolds going up the outside edge. As I understand it, everything is blind mate out the back. InfiniBand networking is out the front — hyperscale style. #GTC24
Tweet media one
5
7
62
@Tobias_Writes
Tobias Mann
2 years
I’m thrilled to announce I’ve joined @TheRegister as the new Systems Editor for @sitpub . I’ll be covering everything from the major OEMs to data center, colo, cloud, and service provider networking and infrastructure. #LifeUpdate #Career #journalism
10
2
60
@Tobias_Writes
Tobias Mann
7 months
Here’s a look inside of a non-DGX GB200 system from Ingrasys ⁦ @HonHai_Foxconn ⁩ Those are blanks in the back standing in for the real chips if you’re wondering. #GTC24
Tweet media one
3
10
57
@Tobias_Writes
Tobias Mann
6 months
@thraxbert Only? Weird how Llama3 runs just fine on my 3-yr-old M1 MacBook Air via Ollama
2
1
51
@Tobias_Writes
Tobias Mann
2 years
@MaxWinebach My Fiancé until just recently was a devout Android user. Maybe its just Pixels, but her phone was always bugging out. Apps soft crashing in unpredictable ways; networking headaches; Bluetooth dropping at random. iOS isn't perfect, but I rarely have issues like that.
4
0
41
@Tobias_Writes
Tobias Mann
10 months
In the 5 years since I proposed, my fiancé and I moved to a new city, started new jobs, adopted a dog, and weathered a pandemic. As we enter 2024, I’m excited to say we’re finally getting around to planning a #wedding , tentatively for the summer of 2025.
Tweet media one
11
0
39
@Tobias_Writes
Tobias Mann
7 months
For the love of all that is good and silicon, not everything is automatically an AI chip now. I've seen reports calling Axion an AI chip. It's NOT. It's a CPU. It does CPU things. Also TPUv5p is NOT new.
6
4
36
@Tobias_Writes
Tobias Mann
2 years
My Fiancé won't let me buy a proper rack/rack mount gear until we get a bigger place. So, this my evening project. What's your "rack" situation look like? #100DaysOfHomeLab
Tweet media one
14
2
31
@Tobias_Writes
Tobias Mann
3 years
@AlyssaM_InfoSec @AristaNetworks Looks like a decent bottle opener, just fill the payload delivery interface with hot glue.
3
1
28
@Tobias_Writes
Tobias Mann
8 months
There's the possibility that Intel could end up fabbing Arm chips that beat its Xeons. I can see plenty of folks on the Intel Product side asking: Why again are we building our competitor's chips? #Intel #IFS
10
4
25
@Tobias_Writes
Tobias Mann
6 months
I'm gonna be honest. I had no idea that Zilog was still kicking, let alone the Z80 that powered the venerable ZX Spectrum. @ssharwood has a full write up over on @TheRegister
3
7
24
@Tobias_Writes
Tobias Mann
7 months
One rack. 120kW of compute. #Nvidia 's new DGX GB200 NVL72 rack-scale system is a beast. Check out my visual guide to the system over on @TheRegister #GTC24
2
7
23
@Tobias_Writes
Tobias Mann
3 years
@appltrack It sure looks like Anker's 521 40W Dual USB-C Charger to me, right down to the lines around the ports. 🤔
Tweet media one
1
0
22
@Tobias_Writes
Tobias Mann
7 months
I took some time to look at Nvidia's #Blackwell 's efficiency gains and how they compare to #Hopper & #Ampere . One of the key takeaways is as these chips cross the 1kW barrier air cooling just ain't cutting it anymore. Full breakdown @TheRegister ⬇️
Tweet media one
4
8
22
@Tobias_Writes
Tobias Mann
7 months
@hellonearthis The servers behind it are from other vendors. A single 10U HGX B200 server is rated for 14.3kW. The DGX GB200 Rack system features 18 1U servers each with two 2,700W GB200 Superchips. The total rack power including NVLink and Infiniband networking is 120kW.
2
0
21
@Tobias_Writes
Tobias Mann
2 years
Over the past month I've been working on a low power 🌿, high-perf home server. It idles at just 40W and maxes out at 120W. Specs ⬇️ #100Daysofhomelab
Tweet media one
3
1
20
@Tobias_Writes
Tobias Mann
4 years
I'm thinking about buying a medium format camera for my birthday. My budget is about $350. What does everyone recommend? #120 #film #photography #filmphotography
27
2
18
@Tobias_Writes
Tobias Mann
7 months
Nvidia just unveiled a fire breathing 40PF (FP4) Grace-Blackwell Superchip that needs liquid cooling to quench its 2,700W power draw. Check out my latest for more on Nvidia’s #Blackwell chips. #gtc24 #AI
4
7
18
@Tobias_Writes
Tobias Mann
2 years
Made some progress on my homelab monitoring dashboards this week. This time tracking power consumption. (It's only been up for a few days so the 28d avg isn't accurate) Built using @grafana @InfluxDB pulling data from NUT server. #100DaysOfHomeLab
Tweet media one
3
1
15
@Tobias_Writes
Tobias Mann
5 months
ChatGPT is down, but don't worry you can spin up your own local #AI #chatbot in about 10 minutes and keep your queries private to boot. 😉 Check out my guide over on @TheRegister :
0
7
15
@Tobias_Writes
Tobias Mann
2 years
Today was spent configuring telegraf on my VMs and containers to pull metrics into Influxdb for a Grafana dashboard. Here's my Proxmox dash if you're looking for some inspiration. #100DaysOfHomeLab
Tweet media one
3
1
15
@Tobias_Writes
Tobias Mann
2 years
If you're worried about what Broadcom's VMware buy will mean for your enterprise infrastructure? It might be worth checking out these alternative virtualization stacks. Via @TheRegister #Datacenter Oh, and let me know if you think I missed any.
5
7
14
@Tobias_Writes
Tobias Mann
5 months
For months, I've been trying to reconcile Blackwell's FP64 regression. Its not a regression, well sort of. Blackwell does 45TF FP64 Matrix, down 32% from Hopper but does 45TF FP64 Vector, up 32%. Why is more complicated. My latest for @theregister
2
4
13
@Tobias_Writes
Tobias Mann
5 years
My work set up. Working outside is a perk I suppose, well when it’s above 60 degrees anyway. #cronovirus #cabinfever
Tweet media one
2
0
12
@Tobias_Writes
Tobias Mann
4 years
As someone who grew up in Northwest Minnesota, the #blizzard2021 in Denver is wild. I've never seen so much new snow pile up so quickly. In 36 hours we've received more than two feet of the wet heavy stuff.
0
1
12
@Tobias_Writes
Tobias Mann
4 years
I am so thankful for my team at @sdxcentral that made it possible for me to escape reality for a week and enjoy my first real vacation — socially distanced of course — since we moved to Denver.
Tweet media one
1
1
12
@Tobias_Writes
Tobias Mann
5 months
Look what showed up at my door today. Fun times ahead. Expect to see more local AI coverage over on @TheRegister soon. #AI #Dev
Tweet media one
1
0
11
@Tobias_Writes
Tobias Mann
8 months
Oh and in case you missed it, I dug into Cerebras' latest dinner-plate sized AI chip. I'm not gonna lie, my brain breaks a little everytime I read 44GB of SRAM 👀
1
3
11
@Tobias_Writes
Tobias Mann
5 months
Can’t help but feel we should really be talking about memory capacity and bandwidth not TOPS with this whole AI PC thing. Those seem to be the bottlenecks we’re looking for.
2
1
11
@Tobias_Writes
Tobias Mann
7 months
Looking forward to Jensen’s keynote tomorrow. Crazy that this my first in person Nvidia shindig since SC19 #GTC24
Tweet media one
0
0
11
@Tobias_Writes
Tobias Mann
2 years
And my wallet wept. But she's happy and that's what matters. #xmas
Tweet media one
2
0
10
@Tobias_Writes
Tobias Mann
5 months
@MaxWinebach For 4bit quantized models you need roughly 0.5GB of fast memory for every billion parameters. 8GB on an iPhone seems reasonable for models in the 4-7 billion parameter regime, but practically you’ll want them to be smaller.
2
0
10
@Tobias_Writes
Tobias Mann
6 months
I've had this happen with my security system and my last car. Thankfully the security system's modem was modular. I made a call and they shipped me a new one. With my car, it was a bigger headache when Verizon EoLed its 3G network.
0
1
10
@Tobias_Writes
Tobias Mann
5 months
It’s about time that AMD offered its Ryzen chips as an enterprise SKU. I’ve got a pair of 3000 and 5000-series Ryzen parts running in ASRock Rack server boards and they’ve been perfect for my homelab needs.
0
1
9
@Tobias_Writes
Tobias Mann
2 years
If you've got a MSI MB, GPU, or PC, be careful about where you download that BIOS update. Hackers claim to have stolen tools necessary to forge malicious firmware and are threatening to release it, if MSI doesn't pay up. By me for @TheRegister
1
6
9
@Tobias_Writes
Tobias Mann
2 years
@AMD and @Arm are getting a ton of attention right now, but don't count out @intel . At the edge, Intel's Xeon D processors are practically uncontested. But that could soon change. Find my analysis @TheRegister here: #semiconductor #edge #EdgeComputing
0
4
10
@Tobias_Writes
Tobias Mann
2 years
Look what I just found cleaning my office. Yes, before I turned to tech, I was a newspaper man. #journalism #reporter #write #press #news
Tweet media one
1
0
10
@Tobias_Writes
Tobias Mann
2 years
My fiance just informed me that she's never seen Monty Python and the Holy Grail... this is going to take time to process.
3
0
9
@Tobias_Writes
Tobias Mann
6 months
The progress @intel and @argonne are making with the Aurora supercomputer is impressive. The system is now the US's second publicly known exascale system and achieved that perf with 87% capacity. But why not a 100 percent? Issues with stability perhaps?
1
1
9
@Tobias_Writes
Tobias Mann
3 years
@SuB8u @arstechnica @Google : I didn't fail. I just found 2,000 ways not to make a messaging service.
0
0
9
@Tobias_Writes
Tobias Mann
2 years
Did some reorganizing to fit my new backup server this afternoon. #100DaysOfHomeLab
Tweet media one
1
1
8
@Tobias_Writes
Tobias Mann
7 months
@HPC_Guru At FP4…
0
0
9
@Tobias_Writes
Tobias Mann
2 years
9 days after testing positive for COVID, I'm officially feeling back to my old self.
0
0
9
@Tobias_Writes
Tobias Mann
3 years
@ExtremeNetworks acquisition of Ipanema's #SDWAN is a fascinating one that fills a bounty of gaps in the company's #SASE strategy. I spoke with Extreme's @BukhariNabil to learn more. Thanks to @zkerravala @WillTownTech and @cdepuy for weighing in.
0
7
9
@Tobias_Writes
Tobias Mann
3 years
@anandtech @intel @Techmeme For point of reference. Intel 4 is the direct rebrand of what Intel had previously called 7nm. But they are all meaningless marketing terms for denser. But calling Intel 4 4nm is not at all accurate.
1
3
8
@Tobias_Writes
Tobias Mann
2 years
Cloud-native architectures have changed the way applications are deployed, but remain relatively uncharted territory for high-performance computing. @RedHat and the U.S. Department of @Energy have a plan to change that. Via @TheRegister
1
1
8
@Tobias_Writes
Tobias Mann
6 months
45Drives is perhaps best known for its dense #storage systems, but more recently the biz has expanded its line-up to #virtualization kit, and now low-power clients and #workstations . Find my exclusive coverage of @45Drives latest kit on @TheRegister ⬇️
1
5
9
@Tobias_Writes
Tobias Mann
7 months
Ready for take off. Next stop #GTC24
Tweet media one
2
0
8
@Tobias_Writes
Tobias Mann
3 years
The mornings are getting cooler. That means sweater weather is right around the corner. It also means my cats are about to get very cuddly. #pets #sweaterweather #fall #kitties #dogs
Tweet media one
1
0
8
@Tobias_Writes
Tobias Mann
2 years
It's 5:30 pm and already dark outside and I hate it. Thanks for coming to my Ted talk.
1
0
8
@Tobias_Writes
Tobias Mann
2 years
3-2-1 Backup strategy is coming together nicely. On Site 🏡 - Primary storage server — 72TB 💾 - Backup Server — 12TB 🔒 Off Site 🌎 - S3 Compatible Bucket 🪣 #100DaysOfHomeLab #BACKUP
Tweet media one
1
2
7
@Tobias_Writes
Tobias Mann
8 months
Cerebras' collab with Qualcomm makes sense. One handles training while other tackles inference. But unless I'm missing something, the AI 100 Ultra looks like it could seriously benefit from an #HBM upgrade or at the very least LPDDR5X memory. Next revision, maybe?
2
2
8
@Tobias_Writes
Tobias Mann
7 months
Intel Foundry wooing Elon? Lets be honest about what this is about. Pat just wants to drum up some drama and get people talking about #18A . #IFS #semiconductors #chips
0
2
8
@Tobias_Writes
Tobias Mann
7 months
@Lost_Signal The density of the rack is a pro/con on power vs distance. They could have gone half as dense across 2 racks with fiber, but it would have apparently cost them an extra 20kW to do that. So, it would have been two 70kW racks instead of one 120kW one.
1
0
8
@Tobias_Writes
Tobias Mann
2 years
My good friend @Nancycliu got this Halloween themed bandana for my pup and I'm dying of acute adorableness.
Tweet media one
1
0
8
@Tobias_Writes
Tobias Mann
6 years
Johanna Rupprecht: “I don’t believe that one family has any more right to farm than any other family does.” #DaleyFarmDebate
1
1
8
@Tobias_Writes
Tobias Mann
3 years
I won the doggo lottery with this one. He is such a well behaved and trained pup.
Tweet media one
2
0
6
@Tobias_Writes
Tobias Mann
4 years
@jennydeluxe Safari > Chrome
0
0
7
@Tobias_Writes
Tobias Mann
2 years
Well that's good. So far I've made it out of SC22 without COVID. Will test again in a few days to be sure.
Tweet media one
1
0
7
@Tobias_Writes
Tobias Mann
4 years
Thank god it's Thursday. This week is flying!
1
0
6
@Tobias_Writes
Tobias Mann
7 months
Marketing: We're coming together to assess the implications of #AI on the #workforce and find opportunities to retrain staff. English: We've assembled to figure out who's getting the AI ax first and how soon we can do it. Now who wants to babysit the AI?
1
3
7
@Tobias_Writes
Tobias Mann
2 years
If you look behind me you'll see the lovely weather we're having here in Dallas. Almost as cold as SC19 in Denver. #SC22
Tweet media one
0
0
7
@Tobias_Writes
Tobias Mann
2 years
GPUs are a powerful tool for machine-learning workloads, though they’re not necessarily the right tool for every AI job, according to Michael Bronstein, Twitter’s head of graph learning research. Via @TheRegister
0
4
7
@Tobias_Writes
Tobias Mann
1 year
Just got back from spending a few days with my family in Duluth. It was absolutely gorgeous, and my dad got to meet the pup for the first time since we got him. #vacation #digitaldetox #familyfun
Tweet media one
Tweet media two
0
0
7
@Tobias_Writes
Tobias Mann
3 years
I don’t always proof read my tweets, but when I do it’s after I hit send.
1
0
7
@Tobias_Writes
Tobias Mann
2 years
I can't believe its already Friday.
0
0
7
@Tobias_Writes
Tobias Mann
5 months
Work is done. That means I can settle into a weekend of... checks notes... server migrations. That can't be right, pretty sure that should read beer. 🍺 Have a great weekend everyone!
1
0
6
@Tobias_Writes
Tobias Mann
5 months
Let’s see what this ROCm thing is like in the real world.
Tweet media one
0
1
8
@Tobias_Writes
Tobias Mann
6 months
@glennklockwood Interconnect penalties, packaging complexity, cache distribution, volume and margins all come into play. If you can produce reticle limited chips at acceptable losses for your margins, then packaging is less an issue Not just Nvidia. It’s Emerald Rapids, Gaudi3 and Blackwell.
0
0
7
@Tobias_Writes
Tobias Mann
2 years
Made some updates to my UPS monitoring dashboard. Working on a version that's sharable. Right now it's pretty hacky. Note: these numbers aren't accurate right now because there's big gaps in the data. #100DaysOfHomeLab
Tweet media one
0
1
6
@Tobias_Writes
Tobias Mann
4 years
Oh god it's happened. I've lost control! 🤣
Tweet media one
0
0
7
@Tobias_Writes
Tobias Mann
2 years
So after reading @lproven 's excellent Linux coverage on @TheRegister , I've come to the conclusion that transactional OSes are simultaneously the future and an oncoming headache for sysadmins. #Linux
2
2
7
@Tobias_Writes
Tobias Mann
3 years
Crisis averted! There was more coffee in the pantry. What are ya'll drinking today? #coffee #friday
Tweet media one
0
0
7
@Tobias_Writes
Tobias Mann
6 months
@FelixCLC_ The worst part of COBOL is how few people write it The best part of COBOL is how few people write it
1
0
7
@Tobias_Writes
Tobias Mann
3 years
@MaxWinebach This would be a hugely popular option for anyone working professionally with social media. I'd love to see it happen.
0
0
5
@Tobias_Writes
Tobias Mann
5 months
Seriously starting to feel like monopoly money now. $1B funding round 🤯 Seriously? This isn't a AI hardware startup either. Scale AI provides labeled data for training models. My latest for @TheRegister
0
3
6
@Tobias_Writes
Tobias Mann
5 months
The fastest, thinnest tablet in the world is now... faster and thinner. Why again should we care, Apple? Beyond your silicon roadmap being a mess that is? Some good points from @rupertg for @TheRegister #Apple #iPad #M4
4
2
6
@Tobias_Writes
Tobias Mann
5 years
The all new SDx launches tomorrow. All the hype of the 90s internet boom with none of the disappointment. Join the movement, jack-in and load-up our new innovative user experience. Networking was never so exciting #NewSDx #SDxCentral
0
1
6
@Tobias_Writes
Tobias Mann
2 years
Come on "Processor" really? I wrote some words on @intel 's new naming scheme for its #Pentium and #Celeron brand.
1
1
6
@Tobias_Writes
Tobias Mann
3 years
I think I've officially reached the point in my life where there is such a thing as too much caffeine 😭. Yesterday I discovered a can of Yerba Mate was 50% too much Yerba Mate...
1
0
6
@Tobias_Writes
Tobias Mann
5 years
When your boss lets you out early before a long weekend, but then you realize you can’t go home because you’ve got an interview coming up. #journalistproblems Everyone have a great holiday!
0
0
5
@Tobias_Writes
Tobias Mann
5 months
So digging into Qualcomm’s X-Elite this thing doesn’t have much memory bandwidth to work with 135GB/s. Really have to wonder how big a detriment that’s gonna have on GPU performance.
3
1
6
@Tobias_Writes
Tobias Mann
2 years
@carlrichell Any chance I can get a tour? I'm local 😉
2
0
6
@Tobias_Writes
Tobias Mann
3 years
Let's just say I'm not a huge fan of @Fortinet and @PaloAltoNtwks ' latest hardware announcements. #network #cybersecurity #security #networking
0
4
6
@Tobias_Writes
Tobias Mann
3 years
@orangebusiness , @VerizonBusiness , and @ATTBusiness topped @VerticalSys new global carrier provided SD-WAN leaderboard this week. #SDWAN #MSP #CSP #Carrier #networking #WAN Here's the latest:
0
4
6
@Tobias_Writes
Tobias Mann
2 years
In case anyone forgot, Cumulus Networks' mascot was a rocket powered turtle, and Nvidia still bought it.
Tweet media one
0
0
6