Delivering double digit IPC improvements (looks like the industry is still competitive).
> The Arm C1 Ultra CPU aims for +25% single-threaded performance and double-digit IPC gains
The new Mali GPU's look not bad too with +20% performance while 9% more power efficient.
And SME2-enabled Armv9.3 cores for on device AI doesn’t sound bad either
What exactly is this on-device AI stuff that everybody is talking about? I'm a mere Sysadmin, so probably I'm missing something here.
The last time I tried to run local LLMs via my 7900XT using LMStudio, even with 20gb of VRAM, they were borderline usable. Fast enough, but quality of the answers and generated code was complete and utter crap. Not even in the same ballpark as ClaudeCode or GPT4/5. I'd love to run some kind of supercharged commandline-completion on there, though.
Edit: I guess my question is: What exactly justifies the extra transistors that ARM here and also AMD with their "AI MAX" keep stuffing onto their chips?
theuppermiddle · 26m ago
I guess AI is not just LLM. Image processing, speech to text etc would fall under the use case.
Regarding GenAI, Pixel phones already run nano model on the phone with decent performance and utility.
rickdeckard · 2h ago
Good.
Curious to see how much of this new arch will actually be adopted by Qualcomm, or whether they will diverge further with their (Nuvia-acquired) Architecture.
Either way, I hope the result is not causing fragmentation in the market (e.g. developers not making use of next-gen ARM features because Qualcomm doesn't support them)
dogma1138 · 1h ago
Given the litigation I don’t see Qualcomm adopting any new cores whilst keeping on with developing theirs it’s going to be too risky as regardless of how many firewalls they put in place ARM could claim that their IP spilled over.
rickdeckard · 1h ago
My last status is that ARM backed down from invalidating ARMs ALA license earlier this year, so Qualcomm still has an architecture license to integrate ARMs designs into their own custom cores.
Am I missing something...?
untrimmed · 46m ago
this feels more like Arm giving its partners the homework to catch up with Apple, rather than a true innovation leap. Apple integrates hardware and software seamlessly. This just provides the raw ingredients.
0points · 33m ago
> This just provides the raw ingredients.
Arm doesn't build operating systems. But you already knew that. So your post is merely troll bait.
M95D · 1h ago
I can only reach the "meh" level of enthusiasm. RK3588 was released in 2022 and AFAIK it still doesn't have video decoding acceleration in mainline kernel/mesa/ffmpeg.
The new Mali GPU's look not bad too with +20% performance while 9% more power efficient.
And SME2-enabled Armv9.3 cores for on device AI doesn’t sound bad either
The last time I tried to run local LLMs via my 7900XT using LMStudio, even with 20gb of VRAM, they were borderline usable. Fast enough, but quality of the answers and generated code was complete and utter crap. Not even in the same ballpark as ClaudeCode or GPT4/5. I'd love to run some kind of supercharged commandline-completion on there, though.
Edit: I guess my question is: What exactly justifies the extra transistors that ARM here and also AMD with their "AI MAX" keep stuffing onto their chips?
Curious to see how much of this new arch will actually be adopted by Qualcomm, or whether they will diverge further with their (Nuvia-acquired) Architecture.
Either way, I hope the result is not causing fragmentation in the market (e.g. developers not making use of next-gen ARM features because Qualcomm doesn't support them)
Am I missing something...?
Arm doesn't build operating systems. But you already knew that. So your post is merely troll bait.