VQA based on image captions

  • 5 Replies
  • 248 Views
*

hainaa

  • Roomba
  • *
  • 4
VQA based on image captions
« on: April 22, 2019, 07:28:47 am »
Hi,

Is there some paper related to the task of answering an image based question given as input an image and its description.
I tried to search online but I didn't find any but I remember some days back I saw such work. If anyone know of some work related to it, please share the link.

Thanks!

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • ***************
  • Deep Blue
  • *
  • 2940
  • First it wiggles, then it is rewarded.
Re: VQA based on image captions
« Reply #1 on: April 22, 2019, 08:46:11 am »
like google deepmind or somethin? I seen something like white images with circles and patterns of problem solving in a video i seen online, on I think it was Two Minute Papers's youtube channel. They make it generally aswer questions like what is the most likely pattern that comes next in this array of circles...
Emergent

*

ivan.moony

  • Trusty Member
  • **********
  • Millennium Man
  • *
  • 1211
    • Some of my projects
Re: VQA based on image captions
« Reply #2 on: April 22, 2019, 10:52:11 am »
Dream big. The bigger the dream is, the more beautiful place the world becomes.

*

hainaa

  • Roomba
  • *
  • 4
Re: VQA based on image captions
« Reply #3 on: April 23, 2019, 05:59:01 am »
No, It's different. It's great work but I want one where input is (question, image , image description) and output is the answer for the question.

*

WriterOfMinds

  • Trusty Member
  • *****
  • Mechanical Turk
  • *
  • 171
    • WriterOfMinds Blog
Re: VQA based on image captions
« Reply #4 on: April 23, 2019, 06:53:11 am »
The closest thing I can think of is Visual Chatbot. It generates the image description rather than taking it as input, but I think it can use dialogue history (including the generated caption?) to help answer followup questions.

https://arxiv.org/abs/1611.08669

*

hainaa

  • Roomba
  • *
  • 4
Re: VQA based on image captions
« Reply #5 on: April 23, 2019, 06:57:59 am »
Actually this is really interesting and maybe I could get ideas from it. Thanks for the link  :)

 


Users Online

33 Guests, 0 Users

Most Online Today: 50. Most Online Ever: 340 (March 26, 2019, 09:47:57 pm)

Articles