Yeah, I don't know what the cost to us is to build out our own hardware but it's significantly less expensive than retail.
I presume that's because it's a custom asic not yet in mass production?
If they can get costs down and put more dies into each card then it'll be business/consumer friendly.
Let's see if they can scale production.
Also, where tf is the next coral chip, alphabet been slacking hard.
I think Coral has been taken to the wooden shed out back. Nothing new out of them for years sadly
Yeah. And it's a real shame bc even before LLMs got big I was thinking, couple generations down the line and coral would be great for some home automation/edge AI stuff.
Fortunately LLMs and hard work of clever peeps running em on commodity hardware are starting to make this possible anyway.
Because Google Home/Assistant just seems to keep getting dumber and dumber...
That seems to be per card instead of chip. I would expect it has multiple chips on a single card.
From the description that doesn't seem to be the case, but I don't know this product well
> Accelerator Cards GroqCard low latency AI/ML Inference PCIe accelerator card with single GroqChip
Missed that! Thanks for pointing out!
At that price 568 chips would be $11.7M