Deep Learning Hardware

  • 4 Replies
  • 3282 Views
*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6860
  • Mostly Harmless
Deep Learning Hardware
« on: April 10, 2017, 11:47:55 pm »

Here's a couple of articles on a blog from a guy called Tim Dettmers.

This first one is from 2015, but I think the overview will still be useful - also it's still getting comments in 2017 and Tim is still responding to them...

http://timdettmers.com/2015/03/09/deep-learning-hardware-guide/

If you read that first one you'll get the idea that GPUs are the way to go. Nvidia seems to be his and the readers' weapon of choice. Since Nvidia brought out their new range around six months back, then I guess there are probably some bargains to be had in second hand kit - I know my old 970 was snapped up pretty quick.

And that brings us on to the second 2017 article which goes into more about choosing GPUs...again he picks out Nvidia...

Quote
NVIDIA’s standard libraries made it very easy to establish the first deep learning libraries in CUDA, while there were no such powerful standard libraries for AMD’s OpenCL. Right now, there are just no good deep learning libraries for AMD cards – so NVIDIA it is. Even if some OpenCL libraries would be available in the future I would stick with NVIDIA: The thing is that the GPU computing or GPGPU community is very large for CUDA and rather small for OpenCL. Thus, in the CUDA community, good open source solutions and solid advice for your programming is readily available.

http://timdettmers.com/2017/04/09/which-gpu-for-deep-learning/

I think it might interest some of you. Korrelan, I think this is getting into your territory.

Personally I've only dabbled with parallel computing on a GPU briefly and did not have much luck. This was back when I was first running morphs through my 3D characters. I was using it to calculate vertex positions. An interesting tangent that I went off on, that was soon better solved another way.

Still, interesting stuff.

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Deep Learning Hardware
« Reply #1 on: April 11, 2017, 02:10:21 am »
If you want to create AI in virtual reality, not many 3D Engines use GPU or multiple CPUs, only Blender can run on GPU, which mostly attracts modelers.

What do I do? The way to go is VR for ex. my baby with many somatosensory sensors. I'm hiring. But the only forum to hire programmers is UE4 - and it's hard/impossible to use multiple CPUs.
Emergent          https://openai.com/blog/

*

Data

  • Trusty Member
  • ***********
  • Eve
  • *
  • 1279
  • Overclocked // Undervolted
    • Datahopa - Share your thoughts ideas and creations
Re: Deep Learning Hardware
« Reply #2 on: April 11, 2017, 10:33:59 am »
Going to need deep pockets to build that rig,

Deep Learning = Deep Pockets.

is that a 1600 watt PSU  :o 

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Deep Learning Hardware
« Reply #3 on: April 11, 2017, 02:26:39 pm »
Going to need deep pockets to build that rig,

Deep Learning = Deep Pockets.

is that a 1600 watt PSU  :o

Not if you can implement the AI efficiently in a small foot-print. I will achieve it.
Emergent          https://openai.com/blog/

*

Data

  • Trusty Member
  • ***********
  • Eve
  • *
  • 1279
  • Overclocked // Undervolted
    • Datahopa - Share your thoughts ideas and creations
Re: Deep Learning Hardware
« Reply #4 on: April 11, 2017, 07:38:32 pm »
LOCKSUIT, sounds like you have a plan there, think I will leave you to it.

Best of luck  :)

 


Will LLMs ever learn what is ... is?
by HS (Future of AI)
November 10, 2024, 06:28:10 pm
Who's the AI?
by frankinstien (Future of AI)
November 04, 2024, 05:45:05 am
Project Acuitas
by WriterOfMinds (General Project Discussion)
October 27, 2024, 09:17:10 pm
Ai improving AI
by infurl (AI Programming)
October 19, 2024, 03:43:29 am
Atronach's Eye
by WriterOfMinds (Home Made Robots)
October 13, 2024, 09:52:42 pm
Running local AI models
by spydaz (AI Programming)
October 07, 2024, 09:00:53 am
Hi IM BAA---AAACK!!
by MagnusWootton (Home Made Robots)
September 16, 2024, 09:49:10 pm
Attempting Hydraulics
by MagnusWootton (Home Made Robots)
August 19, 2024, 04:03:23 am
LLaMA2 Meta's chatbot released
by spydaz (AI News )
August 24, 2024, 02:58:36 pm
ollama and llama3
by spydaz (AI News )
August 24, 2024, 02:55:13 pm
AI controlled F-16, for real!
by frankinstien (AI News )
June 15, 2024, 05:40:28 am
Open AI GPT-4o - audio, vision, text combined reasoning
by MikeB (AI News )
May 14, 2024, 05:46:48 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am

Users Online

457 Guests, 0 Users

Most Online Today: 571. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles