Trying to get GPT-2 Working on Linux?

  • 2 Replies
  • 1672 Views
*

CompSciSarah

  • Roomba
  • *
  • 1
Trying to get GPT-2 Working on Linux?
« on: April 29, 2020, 05:26:46 pm »
I'm interested in installing the GPT-2 model for a book on futurism I'm writing (so that "a voice of the future" so to speak can have its own entry).

I'm having issues installing it though. The older tutorials for how to do so are broken, and I can't figure out how to install the most recent version from github. Cloning the git directory doesn't help much. I'm running Kubuntu 18.04LTS BTW

Thanks!

*

ivan.moony

  • Trusty Member
  • ************
  • Bishop
  • *
  • 1729
    • mind-child
Re: Trying to get GPT-2 Working on Linux?
« Reply #1 on: April 29, 2020, 07:12:35 pm »
Hi O'Connor :)

Can you find an older GPT-2 version, the one that matches the tutorials you have access to?

I think Locksuit, a member around here, managed to install Windows version, if you are up to install Win OS just for that occasion.

As far as my experience goes, there are live online html-js interfaces to GPT-2 scattered over the web. This version seems pretty decent, considering your requirements. You can add on a new content after choosing between offered continuation segments, triggered repeatedly with <tab> key.
« Last Edit: April 29, 2020, 10:14:09 pm by ivan.moony »

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Trying to get GPT-2 Working on Linux?
« Reply #2 on: April 29, 2020, 10:44:29 pm »
the fullest version of gpt2 needs like over 6GB on GPU, and the smaller model of gpt2 i.e. the 3rd or 2nd sizes are just as good at talking, possibly better though I can't tell. The smallest model size lacked just a bit.

openAI's github explains how to install it
make sure to use top-K = 40 parameter in the code
Emergent          https://openai.com/blog/

 


Will LLMs ever learn what is ... is?
by HS (Future of AI)
November 10, 2024, 06:28:10 pm
Who's the AI?
by frankinstien (Future of AI)
November 04, 2024, 05:45:05 am
Project Acuitas
by WriterOfMinds (General Project Discussion)
October 27, 2024, 09:17:10 pm
Ai improving AI
by infurl (AI Programming)
October 19, 2024, 03:43:29 am
Atronach's Eye
by WriterOfMinds (Home Made Robots)
October 13, 2024, 09:52:42 pm
Running local AI models
by spydaz (AI Programming)
October 07, 2024, 09:00:53 am
Hi IM BAA---AAACK!!
by MagnusWootton (Home Made Robots)
September 16, 2024, 09:49:10 pm
Attempting Hydraulics
by MagnusWootton (Home Made Robots)
August 19, 2024, 04:03:23 am
LLaMA2 Meta's chatbot released
by spydaz (AI News )
August 24, 2024, 02:58:36 pm
ollama and llama3
by spydaz (AI News )
August 24, 2024, 02:55:13 pm
AI controlled F-16, for real!
by frankinstien (AI News )
June 15, 2024, 05:40:28 am
Open AI GPT-4o - audio, vision, text combined reasoning
by MikeB (AI News )
May 14, 2024, 05:46:48 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am

Users Online

563 Guests, 0 Users

Most Online Today: 564. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles