Deep Learning Hardware

  • 4 Replies
  • 2673 Views
*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6855
  • Mostly Harmless
Deep Learning Hardware
« on: April 10, 2017, 11:47:55 pm »

Here's a couple of articles on a blog from a guy called Tim Dettmers.

This first one is from 2015, but I think the overview will still be useful - also it's still getting comments in 2017 and Tim is still responding to them...

http://timdettmers.com/2015/03/09/deep-learning-hardware-guide/

If you read that first one you'll get the idea that GPUs are the way to go. Nvidia seems to be his and the readers' weapon of choice. Since Nvidia brought out their new range around six months back, then I guess there are probably some bargains to be had in second hand kit - I know my old 970 was snapped up pretty quick.

And that brings us on to the second 2017 article which goes into more about choosing GPUs...again he picks out Nvidia...

Quote
NVIDIA’s standard libraries made it very easy to establish the first deep learning libraries in CUDA, while there were no such powerful standard libraries for AMD’s OpenCL. Right now, there are just no good deep learning libraries for AMD cards – so NVIDIA it is. Even if some OpenCL libraries would be available in the future I would stick with NVIDIA: The thing is that the GPU computing or GPGPU community is very large for CUDA and rather small for OpenCL. Thus, in the CUDA community, good open source solutions and solid advice for your programming is readily available.

http://timdettmers.com/2017/04/09/which-gpu-for-deep-learning/

I think it might interest some of you. Korrelan, I think this is getting into your territory.

Personally I've only dabbled with parallel computing on a GPU briefly and did not have much luck. This was back when I was first running morphs through my 3D characters. I was using it to calculate vertex positions. An interesting tangent that I went off on, that was soon better solved another way.

Still, interesting stuff.

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Deep Learning Hardware
« Reply #1 on: April 11, 2017, 02:10:21 am »
If you want to create AI in virtual reality, not many 3D Engines use GPU or multiple CPUs, only Blender can run on GPU, which mostly attracts modelers.

What do I do? The way to go is VR for ex. my baby with many somatosensory sensors. I'm hiring. But the only forum to hire programmers is UE4 - and it's hard/impossible to use multiple CPUs.
Emergent          https://openai.com/blog/

*

Data

  • Trusty Member
  • ***********
  • Eve
  • *
  • 1279
  • Overclocked // Undervolted
    • Datahopa - Share your thoughts ideas and creations
Re: Deep Learning Hardware
« Reply #2 on: April 11, 2017, 10:33:59 am »
Going to need deep pockets to build that rig,

Deep Learning = Deep Pockets.

is that a 1600 watt PSU  :o 

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Deep Learning Hardware
« Reply #3 on: April 11, 2017, 02:26:39 pm »
Going to need deep pockets to build that rig,

Deep Learning = Deep Pockets.

is that a 1600 watt PSU  :o

Not if you can implement the AI efficiently in a small foot-print. I will achieve it.
Emergent          https://openai.com/blog/

*

Data

  • Trusty Member
  • ***********
  • Eve
  • *
  • 1279
  • Overclocked // Undervolted
    • Datahopa - Share your thoughts ideas and creations
Re: Deep Learning Hardware
« Reply #4 on: April 11, 2017, 07:38:32 pm »
LOCKSUIT, sounds like you have a plan there, think I will leave you to it.

Best of luck  :)

 


OpenAI Speech-to-Speech Reasoning Demo
by ivan.moony (AI News )
Today at 01:31:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am
Nvidia Hype
by 8pla.net (AI News )
December 06, 2023, 10:04:52 pm
How will the OpenAI CEO being Fired affect ChatGPT?
by 8pla.net (AI News )
December 06, 2023, 09:54:25 pm
Independent AI sovereignties
by WriterOfMinds (AI News )
November 08, 2023, 04:51:21 am
LLaMA2 Meta's chatbot released
by 8pla.net (AI News )
October 18, 2023, 11:41:21 pm

Users Online

282 Guests, 1 User
Users active in past 15 minutes:
8pla.net
[Trusty Member]

Most Online Today: 335. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles