Trying to get GPT-2 Working on Linux?

  • 2 Replies
  • 1796 Views
*

CompSciSarah

  • Roomba
  • *
  • 1
Trying to get GPT-2 Working on Linux?
« on: April 29, 2020, 05:26:46 pm »
I'm interested in installing the GPT-2 model for a book on futurism I'm writing (so that "a voice of the future" so to speak can have its own entry).

I'm having issues installing it though. The older tutorials for how to do so are broken, and I can't figure out how to install the most recent version from github. Cloning the git directory doesn't help much. I'm running Kubuntu 18.04LTS BTW

Thanks!

*

ivan.moony

  • Trusty Member
  • ************
  • Bishop
  • *
  • 1729
    • mind-child
Re: Trying to get GPT-2 Working on Linux?
« Reply #1 on: April 29, 2020, 07:12:35 pm »
Hi O'Connor :)

Can you find an older GPT-2 version, the one that matches the tutorials you have access to?

I think Locksuit, a member around here, managed to install Windows version, if you are up to install Win OS just for that occasion.

As far as my experience goes, there are live online html-js interfaces to GPT-2 scattered over the web. This version seems pretty decent, considering your requirements. You can add on a new content after choosing between offered continuation segments, triggered repeatedly with <tab> key.
« Last Edit: April 29, 2020, 10:14:09 pm by ivan.moony »

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Trying to get GPT-2 Working on Linux?
« Reply #2 on: April 29, 2020, 10:44:29 pm »
the fullest version of gpt2 needs like over 6GB on GPU, and the smaller model of gpt2 i.e. the 3rd or 2nd sizes are just as good at talking, possibly better though I can't tell. The smallest model size lacked just a bit.

openAI's github explains how to install it
make sure to use top-K = 40 parameter in the code
Emergent          https://openai.com/blog/

 


LLaMA2 Meta's chatbot released
by spydaz (AI News )
August 24, 2024, 02:58:36 pm
ollama and llama3
by spydaz (AI News )
August 24, 2024, 02:55:13 pm
AI controlled F-16, for real!
by frankinstien (AI News )
June 15, 2024, 05:40:28 am
Open AI GPT-4o - audio, vision, text combined reasoning
by MikeB (AI News )
May 14, 2024, 05:46:48 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am

Users Online

336 Guests, 1 User

Most Online Today: 353. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles