VQA based on image captions

  • 5 Replies
  • 713 Views
*

hainaa

  • Roomba
  • *
  • 4
VQA based on image captions
« on: April 22, 2019, 07:28:47 am »
Hi,

Is there some paper related to the task of answering an image based question given as input an image and its description.
I tried to search online but I didn't find any but I remember some days back I saw such work. If anyone know of some work related to it, please share the link.

Thanks!

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • ******************
  • Hal 4000
  • *
  • 4353
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: VQA based on image captions
« Reply #1 on: April 22, 2019, 08:46:11 am »
like google deepmind or somethin? I seen something like white images with circles and patterns of problem solving in a video i seen online, on I think it was Two Minute Papers's youtube channel. They make it generally aswer questions like what is the most likely pattern that comes next in this array of circles...
Emergent

*

ivan.moony

  • Trusty Member
  • ***********
  • Eve
  • *
  • 1460
    • contrast-zone
Re: VQA based on image captions
« Reply #2 on: April 22, 2019, 10:52:11 am »
There exist some rules interwoven within this world. As much as it is a blessing, so much it is a curse.

*

hainaa

  • Roomba
  • *
  • 4
Re: VQA based on image captions
« Reply #3 on: April 23, 2019, 05:59:01 am »
No, It's different. It's great work but I want one where input is (question, image , image description) and output is the answer for the question.

*

WriterOfMinds

  • Trusty Member
  • *******
  • Starship Trooper
  • *
  • 354
    • WriterOfMinds Blog
Re: VQA based on image captions
« Reply #4 on: April 23, 2019, 06:53:11 am »
The closest thing I can think of is Visual Chatbot. It generates the image description rather than taking it as input, but I think it can use dialogue history (including the generated caption?) to help answer followup questions.

https://arxiv.org/abs/1611.08669

*

hainaa

  • Roomba
  • *
  • 4
Re: VQA based on image captions
« Reply #5 on: April 23, 2019, 06:57:59 am »
Actually this is really interesting and maybe I could get ideas from it. Thanks for the link  :)

 


Releasing full AGI/evolution research
by LOCKSUIT (General Project Discussion)
November 28, 2020, 06:58:33 pm
New Server
by Data (Announcements)
November 28, 2020, 01:15:52 am
alert manager class for waifubots
by yotamarker (General AI Discussion)
November 27, 2020, 04:12:22 pm
Giving AI rights
by frankinstien (General Project Discussion)
November 26, 2020, 04:26:07 pm
We are computational machines after all!
by MikeB (General Project Discussion)
November 26, 2020, 08:37:45 am
Pattern based NLP
by MikeB (General Project Discussion)
November 26, 2020, 08:28:32 am
I test Jukebox
by LOCKSUIT (General AI Discussion)
November 25, 2020, 11:27:59 pm
This video puts size into perspective.
by frankinstien (Video)
November 25, 2020, 05:14:56 pm
Syntherapy AI psychotherapist game.
by WriterOfMinds (AI News )
November 27, 2020, 05:33:57 pm
Senate Approves Deepfake bill
by LOCKSUIT (AI News )
November 25, 2020, 02:01:18 am
Sony Patent Suggests PS5 Will Have a Chatbot Feature
by frankinstien (AI News )
November 18, 2020, 05:47:45 pm
Potentially life-saving robot scares bears.
by infurl (Robotics News)
November 12, 2020, 12:41:40 am
good news everyone
by HS (AI News )
November 07, 2020, 10:03:04 pm
Meet Kuki
by 8pla.net (AI News )
November 05, 2020, 04:18:34 am
Realistic and Interactive Robot Gaze by Disney Research
by infurl (AI News )
November 03, 2020, 06:33:15 am
less than one-shot learning
by ivan.moony (AI News )
October 26, 2020, 07:45:25 am

Users Online

105 Guests, 1 User
Users active in past 15 minutes:
squarebear
[Trusty Member]

Most Online Today: 116. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles