On-Prem

Systems

Apple reportedly building AI server processor with help from Broadcom

Something called 'Baltra' expected to make its debut in 2026, perhaps with tech both already use


Apple is reportedly working with chip giant Broadcom to develop a custom server processor to power the AI services and features built into its operating systems.

According to The Information, which cites three unnamed sources with knowledge of the matter, the project is codenamed “Baltra” and is expected to enter production in 2026.

Beyond this, details are predictably pretty thin. At the iGiant's developer conference earlier this year, Craig Federighi, SVP of software engineering, declared that Apple Intelligence would run both on-device and in a private cloud using servers powered by Apple Silicon.

The idea that Apple might be building custom chips for GenAI isn't surprising. The iBiz has designed its own Arm-based silicon for years. The idea that Broadcom might be involved in this process shouldn't come as a shock either as the two companies already work together on 5G componentry.

Broadcom is a massive conglomerate that, among other things, licenses intellectual property for use in semiconductor designs – particularly in the field of high-speed networking. For instance, back at the Hot Chips conference we looked at an optical interconnect chiplet designed to be packaged alongside GPUs and other accelerators to support larger scale-up compute clusters.

More recently, Broadcom showed off its 3.5D packaging tech, which is designed to help chipmakers scale beyond reticle limits – similar to what Intel has done with its Ponte Vecchio (GPU Max) GPUs.

AMD used similar techniques to build its MI300X accelerators, which combine eight compute chiplets and vertically stack them on top of four I/O dies which handle memory management and chip-to-chip communication.

Boadcom's 3.5D XDSiP demo chip seen here looks surprisingly similar to AMD's MI300X, but is open to anyone to license – Click to enlarge

Broadcom's 3.5D eXtreme Dimension System in Package tech – 3.5D XDSiP for short – is essentially a blueprint that customers can use to build multi-die processors of their own. Like AMD's MI300X it stacks compute dies on top of a logic die that interfaces with high bandwidth memory (HBM), but breaks out other I/O functionality into a separate set of dies.

Broadcom’s approach to interfacing compute dies interface with the rest of the system logic is a little different. According to Broadcom, previous 3.5D packaging technologies have used face-to-back approaches, which require more work to route through silicon vias (TSVs) which shuttle data between the two.

Broadcom's design uses a face-to-face approach, which allows for denser electrical interfaces between the chiplets using hybrid copper bonding (HBC). We're told this will allow for substantially higher die-to-die interconnect speeds and shorter signal routing.

The largest of these designs will support two 3D stacks, a pair of I/O chiplets, and up to 12 HBM3 modules on a single package totaling more than 6,000 mm² of silicon area. Broadcom expects the first parts based on these designs to enter production in 2026.

Coincidentally, that's the same timeline that The Information reports Apple's project Baltra is aiming at.

It is unclear if the two projects are related. However some Apple chip designs – the M2 Ultra for instance – already make use of multi-die architectures, so it's not a stretch to suggest some overlap.

We likely will not know much more about Baltra until it becomes reality. Apple is notoriously tight-lipped about products before they're officially announced. And while Broadcom is always happy to discuss its chip tech, it's highly secretive about who's actually buying it. Apparently that list includes some pretty big names – for instance, Google reportedly made extensive use of Broadcom IP in its Tensor Processing Units (TPUs). It's not a stretch to imagine Apple taking advantage of existing technologies rather than reinventing the wheel.

The Register sought comment from Broadcom and Apple. Unsurprisingly, neither had responded at the time of publication. ®

Send us news
10 Comments

Apple promises to spend $500B, hire 20K over 4 years to swerve Trump import tariffs

Sorry, that should read: Boost US manufacturing and R&D, believe in the American people, etc etc

Despite Wall Street jitters, AI hopefuls keep spending billions on AI infrastructure

Sunk cost fallacy? No, I just need a little more cash for this AGI thing I’ve been working on

Microsoft's drawback on datacenter investment may signal AI demand concerns

Investment bank claims software giant ditched 'at least' 5 land parcels due to potential 'oversupply'

If you thought training AI models was hard, try building enterprise apps with them

Aleph Alpha's Jonas Andrulis on the challenges of building sovereign AI

Network edge? You get 64-bit Armv9 AI. You too, watches. And you, server remote management. And you...

Arm rolls out the Cortex-A320 for small embedded gear that dreams of big-model inference

Intel cranks up accelerators in Xeon 6 blitz to outgun AMD

But you're probably not cool enough for Chipzilla's 288-core monster

Chinese AI marches on as Baidu makes its chatbot free, Alibaba scores Apple deal

New ‘Deep Search’ thinking and planning bot to go up against peoples’ champion DeepSeek

Satya Nadella says AI is yet to find a killer app that matches the combined impact of email and Excel

Microsoft CEO is more interested in neural nets boosting GDP than delivering superhuman intelligence

Cash torrent pouring into Nvidia slows – despite booming Blackwell adoption

May we all have problems like annual revenue growth dropping from 126 to 114 percent

We meet the protesters who want to ban Artificial General Intelligence before it even exists

STOP AI warns of doomsday scenario, demands governments pull the plug on advanced models

The software UK techies need to protect themselves now Apple's ADP won’t

No matter how deep you are in Apple's 'ecosystem,’ there are ways to stay encrypted in Blighty

Euro cloud biz trials 'server blades in a cold box' system

Hot air or a 50% energy saving? Exoscale datacenter runs proof-of-concept to test veracity of Digger's claims