USB Accelerators

  • 3 Replies
  • 2230 Views
*

frankinstien

  • Replicant
  • ********
  • 642
    • Knowledgeable Machines
USB Accelerators
« on: August 02, 2020, 08:28:21 pm »
The lower power specs are impressive for these accelerators; .5 w per TOPS where it can perform at 4 TOPS, so that just 2 watts! My Vega 56 uses more than 200 watts and produces 21 TOPS in 16-bit mode. You can use several simultaneously,  so 6 would end up using 12 watts! But at a cost of $75 for the Intel NCS 2 and $130 for the Google CUA, 6 would end up totaling $450 for the Intel and $780 for the Google.

Has anyone on this forum used these yet?


*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: USB Accelerators
« Reply #1 on: August 02, 2020, 08:52:42 pm »
For a USB port? Or for AI? I'm lost bro...
Emergent          https://openai.com/blog/

*

frankinstien

  • Replicant
  • ********
  • 642
    • Knowledgeable Machines
Re: USB Accelerators
« Reply #2 on: August 02, 2020, 09:35:16 pm »
For a USB port? Or for AI? I'm lost bro...

The Intel and Google accelerators are AI FPGAs and connect through a USB port.

*

frankinstien

  • Replicant
  • ********
  • 642
    • Knowledgeable Machines
Re: USB Accelerators
« Reply #3 on: August 06, 2020, 05:09:48 am »
I bought one, an Intel NCS2, from the samples it is faster when comparing to a CPU, but the sample code doesn't use all the horsepower of my server. The demo ran 3.5 fps with the CPU compared to 24 fps with the NCS2.  There is a voice recognition sample but my sound card, or should say the USB sound device since the machine uses a server board that has no built-in sound capabilities, would fail for whatever reason. I'm going to have to figure out what's going there. So the drawback is the NCS2 can't train models which means a GPU is still needed but once the model is trained the NCS2 can run it.

Anyway, it was only $75 and worth experimenting with.  8)

 


OpenAI Speech-to-Speech Reasoning Demo
by ivan.moony (AI News )
March 28, 2024, 01:31:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am
Nvidia Hype
by 8pla.net (AI News )
December 06, 2023, 10:04:52 pm
How will the OpenAI CEO being Fired affect ChatGPT?
by 8pla.net (AI News )
December 06, 2023, 09:54:25 pm
Independent AI sovereignties
by WriterOfMinds (AI News )
November 08, 2023, 04:51:21 am
LLaMA2 Meta's chatbot released
by 8pla.net (AI News )
October 18, 2023, 11:41:21 pm

Users Online

346 Guests, 0 Users

Most Online Today: 396. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles