RE: Adding external GPU to my AI box
(Edited)
You are viewing a single comment's thread:
It's roughly the same machine at twice the price
0
0
0.000
You are viewing a single comment's thread:
It's roughly the same machine at twice the price
Well similar with RAM and memory bandwidth but the compute side the Spark is king (1 petaFLOP). But that is coming from someone who installs Nvidia DGX systems for a living so I am slightly biased haha
It's also twice the price and rumors it will be about 10-15% faster.
You know how much the DGX Station is going to run?
The "Station's" are the workstation type servers that take normal power and sit under a desk. To my knowledge Nvidia stopped producing them internally after the Station A100, but other partners may produce them still.
The full fledge DGX servers like the B200 or H200 (latest versions) are in the $300,000 - $400,000 price range just for a single DGX :)
When I set them up I always want to stress test them by mining crypto with them for like a hour haha but never have gotten the approval to do it.
Also I had a customer who had a old station a100 they said they didn't want and I could have but that was 2 years ago and I was an idiot and was offered it about 20 minutes before I had to leave to fly home :( I regret it everyday. Used ones are anywhere from $10,000 - $20,000 now on secondary market.
https://docs.nvidia.com/dgx/dgx-station-a100-user-guide/intro-to-station-a100.html
Talking about this one, been waiting for the announcement.
Ah I didn't know they were bringing back the Nvidia branded Stations... My Nvidia rep didn't mention it so now I gotta go give him some shit haha
Well I do know the Spark's where a priority and those were delayed some and should be shipping out in Q4 finally. But when I head to Nvidia GTC here later this month I will track down any info I can :)
The Sparks were basically to get people hooked on their eco system :P
I'm probably going to go AMD though for obvious reasons.