When buying/building a PC for DNNs, how do you go big+small?

  • 36 Replies
  • 11401 Views
*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
When buying/building a PC for DNNs, how do you go big+small?
« on: March 09, 2018, 12:49:08 pm »
Keeping this simple:

About 1.8 years ago I built my PC. It's a large tower. My laptop in the kitchen is less powerful but still stark and I could fit 10 of them in my tower easily winning in power yet same size.

I know you can construct a supercomputer server stack or do whatever korrelan did (?) and this is very powerful yet as small as it can be. But. I don't know how. Right now I have a Large Tower - it is stronger than an avergae pc, but in the future I would like something say 5 times more powerful (keep in mind new tech) yet not 5 times as big as my Large Tower. In other words how do you go athletic powerhorse yet keep the size of my Large Tower? Tell me da way of the terminator secrets. Is it stacking 3 xeon severs on your desk???
Emergent          https://openai.com/blog/

*

ranch vermin

  • Not much time left.
  • Terminator
  • *********
  • 947
  • Its nearly time!
Re: When buying/building a PC for DNNs, how do you go big+small?
« Reply #1 on: March 09, 2018, 01:00:41 pm »
From my experience of running machine learning stuff is gpus are the cheapest way to give yourself an obscene amount of cores,  but they have limiting factors - theres not much memory and reads and writes to and from it are slower. And sli only gives more cores, doesnt double up the memory.

And if your doing something really seriously,   (but u have to understand the HARDWARE videos, not just the software) actually printing out your own custom brain for it isnt too much to ask for.    if you have a micron density accuracy on a 3d printer, over a cm^3 you can get ~100 gigs of ram.    doesnt that sound smart - even if its harder?     the printer to finish in a week the robobrain has to plot 100k "voxels" in a second.   its a mega highway in cm^3 - takes AGES to plot it.   most ppl with 3d printers probably would say it was too hard - but im not that type of guy.

*

keghn

  • Trusty Member
  • *********
  • Terminator
  • *
  • 824
Re: When buying/building a PC for DNNs, how do you go big+small?
« Reply #2 on: March 09, 2018, 02:48:46 pm »
Build your best tower and then tie them connect it with Gigabit Ethernet to last years build:
https://en.wikipedia.org/wiki/Gigabit_Ethernet

Or you could cluster a bunch of PC together. to make your own super computer:
https://en.wikipedia.org/wiki/Computer_cluster

 The super computer of today are cluster computers of highly trick out pc with highly optimized software. And also use PCIe bus to connect to
other pc in the cluster.


*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: When buying/building a PC for DNNs, how do you go big+small?
« Reply #3 on: March 09, 2018, 04:40:42 pm »
If I'm constructing a NLP AGI, and am going to go deep, what should I better have? And is CPU better for LSTM?
Emergent          https://openai.com/blog/

*

keghn

  • Trusty Member
  • *********
  • Terminator
  • *
  • 824
Re: When buying/building a PC for DNNs, how do you go big+small?
« Reply #4 on: March 09, 2018, 05:45:01 pm »
 GPU for the heavy lifting. Cpu for the light work and multitasking with other mother boards.

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: When buying/building a PC for DNNs, how do you go big+small?
« Reply #5 on: March 09, 2018, 06:55:56 pm »
But NLP AGI is sequentially demanding no?

And will a LSTM run faster on GPU or CPU?
Emergent          https://openai.com/blog/

*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1371
  • Humans will disappoint you.
    • Home Page
Re: When buying/building a PC for DNNs, how do you go big+small?
« Reply #6 on: March 09, 2018, 08:16:48 pm »
For serious applications we never lay hands on the hardware ourselves. We lease server systems from places like Softlayer with dozens of CPUs, hundreds of gigabytes of RAM, terabytes of SSD, and petabytes of disk space. For some tasks we need the whole thing, but mostly we split each one up into dozens of different virtual machines with a few cores dedicated to each one and then allocate them to specific functions. You'd be amazed what you can get for a few thousand dollars a month.

Nowadays the trend is towards just going to the cloud. You can set up instances on Amazon Web Services or Google Compute Engine that start out free but accumulate cost as you use more resources. Note that you can use them for free for quite a while if you are very careful, but it is easy to start running up a bill so be very cautious if you try this. This is the way to go if you want unlimited power.

I just upgraded my personal server with another 4 terabytes of SSD and while I was shopping I had a look around at options for upgrading the rest. I was delighted to find that for five thousand dollars I could put together a new machine with 16 cores and 128GB of RAM. Maybe next month. My research is all in the symbolic domain so I don't have a lot of use for GPUs and I didn't price those this time round.

*

keghn

  • Trusty Member
  • *********
  • Terminator
  • *
  • 824
Re: When buying/building a PC for DNNs, how do you go big+small?
« Reply #7 on: March 09, 2018, 08:22:45 pm »
 CPU starts up and runs main operating system like Windows, Linux, or Apple.
 Mains CPU start and may stop other CPU and GPU programs. CPU is the master organizer of other CPU and GPU programs.
 When CPU does not have the muscle it uses GPU power. ALL deep LSTMs, Deep NN, RNN, and GANs will need GPU power.
 And also game with good graphics, Video editing software, and CGI software.




*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: When buying/building a PC for DNNs, how do you go big+small?
« Reply #8 on: March 09, 2018, 09:18:49 pm »
Oh ya the cloud. Just use Google's supercomputer. Only possible issue is algorithm running on the net haha...

What do you think about that?
Emergent          https://openai.com/blog/

*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1371
  • Humans will disappoint you.
    • Home Page
Re: When buying/building a PC for DNNs, how do you go big+small?
« Reply #9 on: March 09, 2018, 09:32:35 pm »
Locksuit, as far as Google is concerned, your porn profile (#) is more valuable than any ideas that you might have. As long as you can maintain the illusion that you're a raving nutter, nobody will suspect you of having anything worth stealing, so you're safe for now. If you're serious, you should be more worried about your creation escaping into the wild and taking over the world than anyone knowing what you're doing.

(#) Ex Machina: who doesn't love that movie :D


*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: When buying/building a PC for DNNs, how do you go big+small?
« Reply #11 on: March 09, 2018, 10:10:29 pm »
What a beautiful site.

I will definitely bookmark and note this site down as top priority.
Emergent          https://openai.com/blog/

*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1371
  • Humans will disappoint you.
    • Home Page
Re: When buying/building a PC for DNNs, how do you go big+small?
« Reply #12 on: March 09, 2018, 10:19:23 pm »
What a beautiful site. I will definitely bookmark and note this site down as top priority.

That's great, I'm glad you think it will be useful. Just be very careful not to run up any bills that you can't afford to pay. I'm pretty sure you'd get lots of warning emails if you were starting to get out of your depth, but when you're dealing with hardware that powerful it can get out of control scary fast.

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: When buying/building a PC for DNNs, how do you go big+small?
« Reply #13 on: March 09, 2018, 10:33:20 pm »
Don't worry, I have so much time to think and focus. It shouldn't be a problem for me.
Emergent          https://openai.com/blog/

*

ranch vermin

  • Not much time left.
  • Terminator
  • *********
  • 947
  • Its nearly time!
Re: When buying/building a PC for DNNs, how do you go big+small?
« Reply #14 on: March 09, 2018, 10:33:33 pm »
As long as you can maintain the illusion that you're a raving nutter, nobody will suspect you of having anything worth stealing,

haha made my day.

 


Will LLMs ever learn what is ... is?
by HS (Future of AI)
November 10, 2024, 06:28:10 pm
Who's the AI?
by frankinstien (Future of AI)
November 04, 2024, 05:45:05 am
Project Acuitas
by WriterOfMinds (General Project Discussion)
October 27, 2024, 09:17:10 pm
Ai improving AI
by infurl (AI Programming)
October 19, 2024, 03:43:29 am
Atronach's Eye
by WriterOfMinds (Home Made Robots)
October 13, 2024, 09:52:42 pm
Running local AI models
by spydaz (AI Programming)
October 07, 2024, 09:00:53 am
Hi IM BAA---AAACK!!
by MagnusWootton (Home Made Robots)
September 16, 2024, 09:49:10 pm
Attempting Hydraulics
by MagnusWootton (Home Made Robots)
August 19, 2024, 04:03:23 am
LLaMA2 Meta's chatbot released
by spydaz (AI News )
August 24, 2024, 02:58:36 pm
ollama and llama3
by spydaz (AI News )
August 24, 2024, 02:55:13 pm
AI controlled F-16, for real!
by frankinstien (AI News )
June 15, 2024, 05:40:28 am
Open AI GPT-4o - audio, vision, text combined reasoning
by MikeB (AI News )
May 14, 2024, 05:46:48 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am

Users Online

493 Guests, 0 Users

Most Online Today: 485. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles