Trying to get GPT-2 Working on Linux?

  • 2 Replies
  • 1368 Views
*

CompSciSarah

  • Roomba
  • *
  • 1
Trying to get GPT-2 Working on Linux?
« on: April 29, 2020, 05:26:46 pm »
I'm interested in installing the GPT-2 model for a book on futurism I'm writing (so that "a voice of the future" so to speak can have its own entry).

I'm having issues installing it though. The older tutorials for how to do so are broken, and I can't figure out how to install the most recent version from github. Cloning the git directory doesn't help much. I'm running Kubuntu 18.04LTS BTW

Thanks!

*

ivan.moony

  • Trusty Member
  • ************
  • Bishop
  • *
  • 1722
    • mind-child
Re: Trying to get GPT-2 Working on Linux?
« Reply #1 on: April 29, 2020, 07:12:35 pm »
Hi O'Connor :)

Can you find an older GPT-2 version, the one that matches the tutorials you have access to?

I think Locksuit, a member around here, managed to install Windows version, if you are up to install Win OS just for that occasion.

As far as my experience goes, there are live online html-js interfaces to GPT-2 scattered over the web. This version seems pretty decent, considering your requirements. You can add on a new content after choosing between offered continuation segments, triggered repeatedly with <tab> key.
« Last Edit: April 29, 2020, 10:14:09 pm by ivan.moony »

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Trying to get GPT-2 Working on Linux?
« Reply #2 on: April 29, 2020, 10:44:29 pm »
the fullest version of gpt2 needs like over 6GB on GPU, and the smaller model of gpt2 i.e. the 3rd or 2nd sizes are just as good at talking, possibly better though I can't tell. The smallest model size lacked just a bit.

openAI's github explains how to install it
make sure to use top-K = 40 parameter in the code
Emergent          https://openai.com/blog/

 


Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 15, 2024, 08:14:02 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am
Nvidia Hype
by 8pla.net (AI News )
December 06, 2023, 10:04:52 pm
How will the OpenAI CEO being Fired affect ChatGPT?
by 8pla.net (AI News )
December 06, 2023, 09:54:25 pm
Independent AI sovereignties
by WriterOfMinds (AI News )
November 08, 2023, 04:51:21 am
LLaMA2 Meta's chatbot released
by 8pla.net (AI News )
October 18, 2023, 11:41:21 pm

Users Online

295 Guests, 0 Users

Most Online Today: 320. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles