Trying to get GPT-2 Working on Linux?

  • 2 Replies
  • 210 Views
*

CompSciSarah

  • Roomba
  • *
  • 1
Trying to get GPT-2 Working on Linux?
« on: April 29, 2020, 05:26:46 pm »
I'm interested in installing the GPT-2 model for a book on futurism I'm writing (so that "a voice of the future" so to speak can have its own entry).

I'm having issues installing it though. The older tutorials for how to do so are broken, and I can't figure out how to install the most recent version from github. Cloning the git directory doesn't help much. I'm running Kubuntu 18.04LTS BTW

Thanks!

*

ivan.moony

  • Trusty Member
  • ***********
  • Eve
  • *
  • 1458
    • contrast-zone
Re: Trying to get GPT-2 Working on Linux?
« Reply #1 on: April 29, 2020, 07:12:35 pm »
Hi O'Connor :)

Can you find an older GPT-2 version, the one that matches the tutorials you have access to?

I think Locksuit, a member around here, managed to install Windows version, if you are up to install Win OS just for that occasion.

As far as my experience goes, there are live online html-js interfaces to GPT-2 scattered over the web. This version seems pretty decent, considering your requirements. You can add on a new content after choosing between offered continuation segments, triggered repeatedly with <tab> key.
« Last Edit: April 29, 2020, 10:14:09 pm by ivan.moony »
There exist some rules interwoven within this world. As much as it is a blessing, so much it is a curse.

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • ******************
  • Hal 4000
  • *
  • 4333
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Trying to get GPT-2 Working on Linux?
« Reply #2 on: April 29, 2020, 10:44:29 pm »
the fullest version of gpt2 needs like over 6GB on GPU, and the smaller model of gpt2 i.e. the 3rd or 2nd sizes are just as good at talking, possibly better though I can't tell. The smallest model size lacked just a bit.

openAI's github explains how to install it
make sure to use top-K = 40 parameter in the code
Emergent

 


Completed JesseAI's current *Emotion Database*
by frankinstien (General Project Discussion)
Today at 05:29:21 am
Cyborg Dogs!
by Korrelan (General Robotics Talk)
October 22, 2020, 04:40:00 pm
What's everyone up to ?
by Don Patrick (General Chat)
October 20, 2020, 07:51:55 pm
gen 3 skills for the LivinGrimoire
by yotamarker (General AI Discussion)
October 20, 2020, 05:56:03 pm
A.I script writer
by spydaz (General AI Discussion)
October 20, 2020, 02:10:46 pm
shelf stocking algorithm
by yotamarker (General AI Discussion)
October 19, 2020, 04:08:53 pm
Worse Than Death
by yotamarker (General AI Discussion)
October 19, 2020, 04:08:27 pm
Pattern based NLP
by MikeB (General Project Discussion)
October 12, 2020, 09:16:23 am
Scavengers by Improbable
by MikeB (AI News )
October 20, 2020, 06:51:05 am
Sony Patent Suggests PS5 Will Have a Chatbot Feature
by MikeB (AI News )
October 19, 2020, 09:32:40 am
efficiency breakthrough via mathematics
by infurl (AI News )
October 14, 2020, 09:47:44 am
deep drone
by infurl (Robotics News)
October 13, 2020, 03:08:39 am
cerebellum much more important than previously thought
by infurl (AI News )
October 13, 2020, 03:06:29 am
electronic neurons
by Hopefully Something (AI News )
October 02, 2020, 12:06:39 am
New model beats GPT3
by LOCKSUIT (AI News )
October 01, 2020, 11:54:25 am
Robotic vacuum cleaner news.
by Dat D (Robotics News)
September 29, 2020, 10:15:58 am

Users Online

137 Guests, 1 User

Most Online Today: 165. Most Online Ever: 528 (August 03, 2020, 06:16:11 am)

Articles