In my regular research (behind a paywall), I have been saying for a while that I think the future of AI is not large language models (LLM), but small language models (SLM) run on local desktop computers or even mobile phones.
Yes. The issue is not that ARM systems don’t/can’t communicate with a dGPU over PCIe. It’s that x86 systems (edit: running conventional x86 desktop OSes) have to basically pretend they’re using PCIe to communicate with an iGPU. (Not literally, but a lot of the primitives they use were inherited from AGP/PCI and don’t make a lot of sense for an SoC.)
Aren’t there arm workstations that still take pcie cards and have a similar architecture to x86?
Yes. The issue is not that ARM systems don’t/can’t communicate with a dGPU over PCIe. It’s that x86 systems (edit: running conventional x86 desktop OSes) have to basically pretend they’re using PCIe to communicate with an iGPU. (Not literally, but a lot of the primitives they use were inherited from AGP/PCI and don’t make a lot of sense for an SoC.)
@jumping_redditor @kibiz0r
You really need to read this series:
https://marcin.juszkiewicz.com.pl/2025/07/07/arm-desktop-2025-attempt-part-one/