Ai Dreams Forum

Member's Experiments & Projects => AI Programming => Topic started by: infurl on October 17, 2021, 05:18:13 am

Title: General Purpose Question-Answering with MACAW
Post by: infurl on October 17, 2021, 05:18:13 am: If you wanted a powerful artificial intelligence system to complete your pet project but don't have access to GPT3 then you're in luck because now there is MACAW which is fully open source and freely available. The largest model needs around 48GB of GPU memory to operate but there are some smaller models available too.

I first learned about it here:

https://www.reddit.com/r/LanguageTechnology/comments/q9qebq/allen_institute_for_ai_ai2_opensources_macaw_a/

The source code is here including some impressive examples of it in use:

https://github.com/allenai/macaw

The paper describing it in depth is here:

https://arxiv.org/pdf/2109.02593.pdf
Title: Re: General Purpose Question-Answering with MACAW
Post by: frankinstien on October 17, 2021, 07:34:41 pm: Has anyone here tried to actually use this on Google Cloud?
Title: Re: General Purpose Question-Answering with MACAW
Post by: WriterOfMinds on October 17, 2021, 09:20:24 pm: I was going to save this for when I had time to run some tests on it, but the 6-billion parameter GPT-J model is also now up with a public interface: https://6b.eleuther.ai/
Title: Re: General Purpose Question-Answering with MACAW
Post by: 8pla.net on October 18, 2021, 08:30:48 am: On the GPT-J model public interface I tested with this, "Adam told a secret to Betty, then Betty told that to Charlie, then Charlie told that to Donna, then Donna told that to Edward, then Edward told that to Felisha, then what was that?" The results were surprising.
Title: Re: General Purpose Question-Answering with MACAW
Post by: Zero on January 13, 2022, 10:35:02 pm: GOFAI Forever - No Regrets :35:
Title: Re: General Purpose Question-Answering with MACAW
Post by: infurl on January 13, 2022, 10:43:09 pm: More information please? :o
Title: Re: General Purpose Question-Answering with MACAW
Post by: Zero on January 14, 2022, 07:54:13 am: :) I'll always be more excited by GOFAI (https://www.cambridge.org/core/books/abs/cambridge-handbook-of-artificial-intelligence/gofai/FCF7D6DD921658FE8AE9F2A2B0FECBDD) than by bleeding edge 48Gigs magical hole-fillers. Hence the 'GOFAI' tattoo.
Title: Re: General Purpose Question-Answering with MACAW
Post by: infurl on January 14, 2022, 08:32:12 am: Well you say that now, but what if GOFAI becomes your ex-girlfriend?
Title: Re: General Purpose Question-Answering with MACAW
Post by: Zero on January 14, 2022, 10:26:35 am: ;D Then I guess I'd have to cover this tattoo with another one!

https://www.qwant.com/?t=images&q=parrot+tattoo

Edit: Of course I recognize that these technics are impressive, and work a lot like (one of the functions of) brains. Still, there seems to be a missing "core". Is there, somewhere, a project based on these technics (I mean a project such as GPT, MACAW...) that would be set up so the agent (which runs the model) uses its understanding of a situation to choose its behavior or next action?
Title: Re: General Purpose Question-Answering with MACAW
Post by: LOCKSUIT on January 14, 2022, 07:16:07 pm: Quote from: WriterOfMinds on October 17, 2021, 09:20:24 pm
I was going to save this for when I had time to run some tests on it, but the 6-billion parameter GPT-J model is also now up with a public interface: https://6b.eleuther.ai/

GPT-3 has been free to try for the last month, I tried it. The wait-list has been taken off. But they probably are giving you a free credit that is temporary.