General Purpose Question-Answering with MACAW

  • 9 Replies
  • 1020 Views
*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1346
  • Humans will disappoint you.
    • Home Page
General Purpose Question-Answering with MACAW
« on: October 17, 2021, 05:18:13 am »
If you wanted a powerful artificial intelligence system to complete your pet project but don't have access to GPT3 then you're in luck because now there is MACAW which is fully open source and freely available. The largest model needs around 48GB of GPU memory to operate but there are some smaller models available too.

I first learned about it here:

https://www.reddit.com/r/LanguageTechnology/comments/q9qebq/allen_institute_for_ai_ai2_opensources_macaw_a/

The source code is here including some impressive examples of it in use:

https://github.com/allenai/macaw

The paper describing it in depth is here:

https://arxiv.org/pdf/2109.02593.pdf

*

frankinstien

  • Replicant
  • ********
  • 618
    • Knowledgeable Machines
Re: General Purpose Question-Answering with MACAW
« Reply #1 on: October 17, 2021, 07:34:41 pm »
Has anyone here tried to actually use this on Google Cloud?

*

WriterOfMinds

  • Trusty Member
  • ********
  • Replicant
  • *
  • 527
    • WriterOfMinds Blog
Re: General Purpose Question-Answering with MACAW
« Reply #2 on: October 17, 2021, 09:20:24 pm »
I was going to save this for when I had time to run some tests on it, but the 6-billion parameter GPT-J model is also now up with a public interface: https://6b.eleuther.ai/

*

8pla.net

  • Trusty Member
  • ***********
  • Eve
  • *
  • 1276
  • TV News. Pub. UAL (PhD). Robitron Mod. LPC Judge.
    • 8pla.net
Re: General Purpose Question-Answering with MACAW
« Reply #3 on: October 18, 2021, 08:30:48 am »
On the GPT-J model public interface I tested with this, "Adam told a secret to Betty, then Betty told that to Charlie, then Charlie told that to Donna, then Donna told that to Edward, then Edward told that to Felisha, then  what was that?"  The results were surprising.
My Very Enormous Monster Just Stopped Using Nine

*

Zero

  • Eve
  • ***********
  • 1287
Re: General Purpose Question-Answering with MACAW
« Reply #4 on: January 13, 2022, 10:35:02 pm »
GOFAI Forever - No Regrets   :35:

*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1346
  • Humans will disappoint you.
    • Home Page
Re: General Purpose Question-Answering with MACAW
« Reply #5 on: January 13, 2022, 10:43:09 pm »
More information please?  :o

*

Zero

  • Eve
  • ***********
  • 1287
Re: General Purpose Question-Answering with MACAW
« Reply #6 on: January 14, 2022, 07:54:13 am »
:) I'll always be more excited by GOFAI than by bleeding edge 48Gigs magical hole-fillers. Hence the 'GOFAI' tattoo.

*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1346
  • Humans will disappoint you.
    • Home Page
Re: General Purpose Question-Answering with MACAW
« Reply #7 on: January 14, 2022, 08:32:12 am »
Well you say that now, but what if GOFAI becomes your ex-girlfriend?

*

Zero

  • Eve
  • ***********
  • 1287
Re: General Purpose Question-Answering with MACAW
« Reply #8 on: January 14, 2022, 10:26:35 am »
 ;D  Then I guess I'd have to cover this tattoo with another one!

https://www.qwant.com/?t=images&q=parrot+tattoo



Edit: Of course I recognize that these technics are impressive, and work a lot like (one of the functions of) brains. Still, there seems to be a missing "core". Is there, somewhere, a project based on these technics (I mean a project such as GPT, MACAW...) that would be set up so the agent (which runs the model) uses its understanding of a situation to choose its behavior or next action?
« Last Edit: January 14, 2022, 10:53:48 am by Zero »

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4638
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: General Purpose Question-Answering with MACAW
« Reply #9 on: January 14, 2022, 07:16:07 pm »
I was going to save this for when I had time to run some tests on it, but the 6-billion parameter GPT-J model is also now up with a public interface: https://6b.eleuther.ai/

GPT-3 has been free to try for the last month, I tried it. The wait-list has been taken off. But they probably are giving you a free credit that is temporary.
Emergent          https://openai.com/blog/