ServeTheHome provides insights and analysis delivered to you since 2009. We specialize in the data center industry with servers, storage, and networking.
The AMD Instinct MI300 was shown at CES 2023 this year along with new details about the multi-chip CPU, GPU, and HBM3 memory part. That is a big chip!
@AMD
@AMDServer
The ASRock Rack ALTRAD8U-1L2T is set to bring 128 Ampere Altra Max Arm cores to new places in this mATX form factor motherboard. This is awesome for Arm developers.
@ASROCKRACK
@ampere
@arm
#ISC23
STH turns 14 today so a few thank yous and quick updates are in order. It is hard to believe STH has been around this long! From a side project while doing consulting to serving millions of folks each month.
We saw the AMD Instinct MI300A (giant APU) and MI300X (GPU) at SC23 and learned new things about AMD's new AI and HPC platforms
@AMD
@AMDServer
@GIGABYTEUSA
#SC23
AMD EPYC 9004 Genoa Gaps Intel Xeon with 96 cores and a massive new platform. This gen/gen performance and efficiency gain is almost unheard of in the industry. We get deep in the details. Grab some popcorn and dig in:
@AMD
@AMDServer
@AMDNews
We deep-dive into the 4th Generation Intel Xeon Scalable processors, codenamed Sapphire Rapids, to see a huge leap in Xeon capabilities
@Intel
@intelnews
@IntelBusiness
The Intel Xeon Max 9480 is a crazy CPU. Not only is it a HPC focused part with 64GB of HBM2e onboard and 8x DDR5 channels, but you can even do things like pull all of the DDR5 and it just works booting OSes and even running VMs
@Intel
@IntelBusiness
The new AMD EPYC Bergamo will have 128 cores, 256 threads per socket meaning a common 2U 4-node platform will have 2048 threads. This is a processor segment that we expect will account for more than 25% of all data center processor sales within 5 years, so it is a huge deal.
There are Intel Silicon Photonics 100G QSFP28 2km CWDM4 optics out there for under $6 that appear to have come from a hyper-scaler. It is fun to see these optics available after we first covered them in 2017.
@Intel
Broadcom said it will support AMD XGMI or "Infinity Fabric" on its next-gen PCIe switches and we expect future XGMI NICs in a big counter to NVIDIA as the MI300X is selling like crazy
@Broadcom
@AMD
@AMDServer
@NVIDIA
$AMD
The Apple M3 family of chips launched with some advancements but also intentionally shaky performance claims that should warrant a look by consumer protection agencies
@Apple
At SC23, we saw the Cornelis Networks 576-port 400Gbps Omni-Path CN5000 director switch with a whopping 48kW of power supplies
@CornelisHPC
#SC23
@Supercomputing
We get hands-on with the AMD Pensando DSC2-100G Elba DPU in a secret lab to see the hardware and how VMware integrates the 100GbE cards into vSphere
@AMD
@AMDNetworking
@VMware
@MyVMUG
@Dell
We take a look at the MikroTik CRS504-4XQ-IN and see how this sub $699 (street price)/ 45W switch may be the perfect SMB and
#homelab
100GbE and 25GbE switch. This is an impressive and compact package.
@mikrotik_com
@MarvellTech
We go into why an entire line of high-end
@Dell
switches and possibly even a
@HPE_Cray
US military supercomputer have misspelled stickers that say American "MegatrAnds". This prompts big questions on how well the supply chain is being checked.
#SupplyChain
Intel announced Thunderbolt 5 with 80Gbps-120Gbps of connectivity for higher-end displays, storage, networking, and eGPU connectivity
@intelnews
@intel
We can now publish a few photos of the physical NVIDIA H100 SXM card from a visit to NVIDIA HQ about a month ago. Hello Hopper!
@NVIDIA
@NVIDIADC
@NVIDIAAI
#AI
Intel Performance Strategy Team Publishing Intentionally Misleading Benchmarks - We dissect a single result to see what Intel is doing to make the Platinum 9282 series look acceptable. How did this pass muster?
The new MikroTik CRS310-8G+2S+IN is an 8-port 2.5GbE switch with two SFP+ ports and a beefy Marvell switch chip. Finally MikroTik 2.5GbE! Now hoping we can get one soon-ish to add to the 2.5GbE switch Buyer's Guide
@mikrotik_com
@MarvellTech
With the Intel Core Ultra 200V series, Intel is making radical changes. The new chips ditch Hyper-Theading, get a new iGPU, and onboard memory and more
@intel
We take a look at the 4th Generation Intel Xeon Scalable CPUs with onboard HBM2E codenamed the Intel Sapphire Rapids HBM shown at Vision 2022
@Intel
@IntelBusiness
#IntelON
ASRock Rack did it! In our ASRock Rack 1U4LW-B650/2L2T review we see why this AMD Ryzen server offers a huge power/performance gap over Intel's alternatives in this space. This is AWESOME!
@ASROCKRACK
@AMD
@AMDRyzen
This new R86S Pro now has twice as many cores and twice the RAM, twice the onboard eMMC, 3x 2.5GbE, 2x 25GbE, and WiFi. This will revolutionize the portable/ home lab space
@Intel
@NVIDIANetworkng
AMD announced the date for the EPYC 7003 series codenamed "Milan". We cracked the code how
@AMDServer
may or may not have coordinated with a popular cookie brand to communicate the March 15 date prior to today's announcement. Very clever
@LisaSu
and
@AMD
We delve into the new AMD Instinct MI300X GPU, MI300A APU, and see how AMD has built packages to go head-to-head with the NVIDIA H100 and win
@AMD
@AMDServer
#AI
This is a new fanless low-power homelab system with a 6W TDP Intel CPU. If you want way more performance and I/O than a Raspberry Pi 5 or ZimaBoard in about the same price band, then this is peerless in today's market
In our HighPoint SSD7540 review, we see how this PCIe Gen4 x16 card lets you add 8x M.2 NVMe SSDs to a system. Featuring 8x Sabrent Rocket 4 Plus NVMe SSDs
@Sabrent
This fanless server might have EVERYTHING including an Intel Atom C3758, 4x SFP+ 10GbE, 2.5GbE, SSD slots, and external HDD connections. If you are making a NAS, firewall, or virtualization host this can save over $1000 and is silent
We test the new Intel N100 Alder Lake-N 4x 2.5GbE fanless firewall and virtualization appliance to find a MASSIVE generational performance jump and a number of quality upgrades
@Intel
We take a look at the massive Microsoft Azure HBv4 heatsink that cools two AMD EPYC 9004 "Genoa" CPUs dwarfing others we have seen
@Microsoft
@Azure
@AMD
@AMDServer
We take a look at the massive Micron 9400 30.72TB and see how this is not just a large PCIe Gen4 NVMe SSD, it is also perhaps the fastest of its kind
@MicronTech
We saw the 150W and 75W Intel Arctic Sound-M data center GPUs at Intel Vision 2022 and heard a bit about the target applications
@Intel
@IntelGraphics
#IntelON
We get hands-on with the massive Intel LGA7529 socket at OCP Summit 2023. This is the 12-channel DDR5 socket for Intel's 2024 generation CPUs
@OpenComputePrj
@intel
In our AMD EPYC 7371 review, we show how this frequency optimized processor is now the fastest 16 core x86 CPU around. It will change the narrative of AMD EPYC (Naples) versus Intel Xeon (Skylake-SP) in a market shifting manner.
@AMDServer
We take a look at the awesome ASRock Rack AM5D4ID-2T/BCM motherboard that brings 10Gbase-T networking to a compact AMD Ryzen AM5 platform
@ASROCKRACK
@AMD
@AMDRyzen
@Broadcom
We take a look at the 64-port 400GbE Broadcom Tomahawk 4 switch chip and the LGA8371 socket it uses to show some fun networking hardware. Very few get to see these cool chips!
@Broadcom
We tested WD Red SMR v CMR drives to see if there was indeed a significant impact with the change simply using them as replacement drives. We found SMR can put data at risk 13-16x longer than CMR.
@westerndigital
@freenas
#ZFS
In 2025 Intel Xeon D will get HUGE with the Intel Xeon 6 Granite Rapids-D platform. 100GbE, AMX, media encoders, lossless compression, 8-channel MCRDIMM memory, and more. WOW!!!
@Intel
@Intelbusiness
@hotchipsorg
Our AMD EPYC 7702P benchmarks and review. Redefining what is possible in a single socket with 64 cores and 128 threads. The TCO impacts are enough to see massive socket consolidation on 3-year and 5-year replacement cycles.
@AMDServer
At Intel Innovation 2022, Intel confirmed it will have 4 and 8 socket 4th Gen Xeon platforms for up to 480 cores and 960 threads per server
@Intel
#IntelON
Intel showed its GPU Max 1550 series at SC23 but it also expects to have a 144GB class Gaudi3 AI accelerator in 2024 to compete with NVIDIA's newly announced 141GB H200
@Intel
@Intelnews
@IntelBusiness
#AI
#SC23
STH had a great visit with
@AmpereComputing
today and was able to hold an 80-core Altra
@Arm
processor. Here it is next to a strategically placed Diet Coke can for scale. This is a big package that dwarfs current Xeon socketed parts.
Tesla brought its Dojo V1 networking hardware to Hot Chips 2024 and announced that it is donating its own TTPoE protocol to the Ultra Ethernet Consortium
@ultraethernet
@Tesla
@hotchipsorg
We take a look at the NVIDIA DGX GB200 NVL72, NVIDIA's new liquid cooled ultra AI machine that will be shipping later this year
@NVIDIA
@NVIDIAAI
#GTC24
Today Intel and Argonne National Labs announced that the Intel Xeon Max and GPU Max Aurora supercomputer blade installation is complete. That means over 63K "spaceship" GPUs, combining dozens of tiles from different fabs each, actually work.
@Intel
The HPE ProLiant RL300 Gen11 is a new leadership cloud-native Ampere Altra Max Arm platform bringing 128 Arm cores to the ProLiant ecosystem
@HPE
@HPE_News
@AmpereComputing
@Arm
The Intel IPU E2100 DPU is finally hitting the market with 16 Arm Neoverse N1 cores, 48GB of memory and support for Red Hat OpenShift
@Intel
@intelnews
@Arm
@RedHat
In our ASUS ESC4000A-E10 review, we see how this server combines a single AMD EPYC 7002 and 4x GPUs (NVIDIA Quadro RTX 6000 passively cooled in our case) to provide a unique GPU compute solution
@ASUS
@ASUSUSA
@AMDServer
@NVIDIADC
@NVIDIAAI
We delve into the new Intel Xeon W-3400 and Xeon W-2400 series bringing PCIe Gen5 lanes, DDR5, and more cores to the workstation market. This is a big move by Intel, and so we get into how these chips are created.
@Intel
@IntelBusiness
The new Noctua NH-D9 AMP-4926 4U and NH-U14S AMP-4926 are the last pieces needed to make Ampere Altra Arm development desktops and desktop servers viable
@AmpereComputing
@Noctua_at
@ASROCKRACK
@Arm