AMD GPUs Support GPU-Accelerated Machine Learning

  • 3 Replies
  • 1755 Views
*

frankinstien

  • Replicant
  • ********
  • 652
    • Knowledgeable Machines
AMD GPUs Support GPU-Accelerated Machine Learning
« on: December 17, 2021, 09:47:07 pm »
Well the RTX 3080 for $800 bucks ended up being a fraud where eBay promptly refunded me. There appear to be lots of fake high-performance GPUs for sale. eBay actually started the return process for me from the seller I purchased from, obviously a repeat offender! So I tried another seller on Amazon where they were selling it for $1288.00, however, the package conveniently has been delayed at LAX after passing customs for 5 days now for some reason. Some on Amazon have complained about the seller and they never received the GPU. The carrier is 4PX, maybe they're in cahoots with the seller and 4PX is just posting shipping detail updates to fool me? In any case, if I don't get the GPU by today I get a refund from Amazon. So, now it comes to affordability and the AMD high-end GPUs are looking pretty interesting at $1600 or just under. The problem is no Cuda support but AMD and Microsoft have an alternative you can read about it here.

I really wanted to go with Nvidia this time out, I could go with a lower-end GPU like an RTX 3070. The strong point of the AMD Radeon RX 6900 XT is 16GB of DDR6 ram and theoretical performance of 46 TFLOPs for 16 bit precision! Where the RTX 3080 theoretical performance of the same precision is 29.77 TFLOPs.

*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1371
  • Humans will disappoint you.
    • Home Page
Re: AMD GPUs Support GPU-Accelerated Machine Learning
« Reply #1 on: December 18, 2021, 12:29:58 am »
It would be very difficult to find a good GPU card at the moment with all the idiots scrabbling for cryptocurrency and the scammers who are preying on them. Have you considered getting GPU in the cloud? I've had good experiences with Linode and can recommend them if Linux is your thing. You can get an RTX6000 which is roughly equivalent to the card that you're trying to buy for $1.50 an hour or $1000 per month. You can have up to four of them per node.

https://www.linode.com/products/gpu/

https://technical.city/en/video/Quadro-RTX-6000-vs-GeForce-RTX-3080-Ti

I expect there are lots of options to choose from elsewhere but based on my experience they are likely to be more expensive than that.

https://thechief.io/c/editorial/comparison-cloud-gpu-providers/
« Last Edit: December 18, 2021, 04:39:16 am by infurl »

*

MagnusWootton

  • Replicant
  • ********
  • 646
Re: AMD GPUs Support GPU-Accelerated Machine Learning
« Reply #2 on: December 18, 2021, 11:19:47 am »
no CUDA support?  I dont understand that.
I think the way I'm doing my GPU code is getting phased out,  doesn't bother me tho entirely, I'm shipping over to FPGA's from now on,    the GTX980 is going to be my last GPU.

I might just get my last old computer (with the 2048 cuda cores on it.), whack some legs on it - and I can repurpose it as a robot, in ancient DX11. :)

*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1371
  • Humans will disappoint you.
    • Home Page
Re: AMD GPUs Support GPU-Accelerated Machine Learning
« Reply #3 on: December 21, 2021, 10:51:32 pm »
https://spectrum.ieee.org/ibm-mainframe

Quote
WHENEVER I HEAR SOMEONE RHAPSODIZE about how much more computer power we have now compared with what was available in the 1960s during the Apollo era, I cringe. Those comparisons usually grossly underestimate the difference.

According to these calculations the progress made in 60 years is far greater than most people realise, especially when you factor in GPUs.

edit: Haha I really should have finished reading the article before I posted it.

 


Will LLMs ever learn what is ... is?
by HS (Future of AI)
November 10, 2024, 06:28:10 pm
Who's the AI?
by frankinstien (Future of AI)
November 04, 2024, 05:45:05 am
Project Acuitas
by WriterOfMinds (General Project Discussion)
October 27, 2024, 09:17:10 pm
Ai improving AI
by infurl (AI Programming)
October 19, 2024, 03:43:29 am
Atronach's Eye
by WriterOfMinds (Home Made Robots)
October 13, 2024, 09:52:42 pm
Running local AI models
by spydaz (AI Programming)
October 07, 2024, 09:00:53 am
Hi IM BAA---AAACK!!
by MagnusWootton (Home Made Robots)
September 16, 2024, 09:49:10 pm
Attempting Hydraulics
by MagnusWootton (Home Made Robots)
August 19, 2024, 04:03:23 am
LLaMA2 Meta's chatbot released
by spydaz (AI News )
August 24, 2024, 02:58:36 pm
ollama and llama3
by spydaz (AI News )
August 24, 2024, 02:55:13 pm
AI controlled F-16, for real!
by frankinstien (AI News )
June 15, 2024, 05:40:28 am
Open AI GPT-4o - audio, vision, text combined reasoning
by MikeB (AI News )
May 14, 2024, 05:46:48 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am

Users Online

374 Guests, 0 Users

Most Online Today: 369. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles