VQA based on image captions

  • 5 Replies
  • 1521 Views
*

hainaa

  • Roomba
  • *
  • 4
VQA based on image captions
« on: April 22, 2019, 07:28:47 am »
Hi,

Is there some paper related to the task of answering an image based question given as input an image and its description.
I tried to search online but I didn't find any but I remember some days back I saw such work. If anyone know of some work related to it, please share the link.

Thanks!

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: VQA based on image captions
« Reply #1 on: April 22, 2019, 08:46:11 am »
like google deepmind or somethin? I seen something like white images with circles and patterns of problem solving in a video i seen online, on I think it was Two Minute Papers's youtube channel. They make it generally aswer questions like what is the most likely pattern that comes next in this array of circles...
Emergent          https://openai.com/blog/

*

ivan.moony

  • Trusty Member
  • ************
  • Bishop
  • *
  • 1721
    • mind-child
Re: VQA based on image captions
« Reply #2 on: April 22, 2019, 10:52:11 am »

*

hainaa

  • Roomba
  • *
  • 4
Re: VQA based on image captions
« Reply #3 on: April 23, 2019, 05:59:01 am »
No, It's different. It's great work but I want one where input is (question, image , image description) and output is the answer for the question.

*

WriterOfMinds

  • Trusty Member
  • ********
  • Replicant
  • *
  • 605
    • WriterOfMinds Blog
Re: VQA based on image captions
« Reply #4 on: April 23, 2019, 06:53:11 am »
The closest thing I can think of is Visual Chatbot. It generates the image description rather than taking it as input, but I think it can use dialogue history (including the generated caption?) to help answer followup questions.

https://arxiv.org/abs/1611.08669

*

hainaa

  • Roomba
  • *
  • 4
Re: VQA based on image captions
« Reply #5 on: April 23, 2019, 06:57:59 am »
Actually this is really interesting and maybe I could get ideas from it. Thanks for the link  :)

 


OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 15, 2024, 08:14:02 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am
Nvidia Hype
by 8pla.net (AI News )
December 06, 2023, 10:04:52 pm
How will the OpenAI CEO being Fired affect ChatGPT?
by 8pla.net (AI News )
December 06, 2023, 09:54:25 pm
Independent AI sovereignties
by WriterOfMinds (AI News )
November 08, 2023, 04:51:21 am
LLaMA2 Meta's chatbot released
by 8pla.net (AI News )
October 18, 2023, 11:41:21 pm
AI-Generated Art Cannot Receive Copyrights
by frankinstien (AI News )
August 24, 2023, 08:49:45 am

Users Online

164 Guests, 0 Users

Most Online Today: 248. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles