New javascript library for animating Chatbots on the web - talkr

  • 10 Replies
  • 276 Views
*

bot_animator

  • Roomba
  • *
  • 2
Hi Everyone,

I wanted to introduce a new javascript library ( https://github.com/talkr-app/gif-talkr ) that may be useful for animating text-to-speech enabled Chatbots on the web.  Here is a demo that will play an arbitrary TTS message back to you.  ( http://talkrapp.com/gifdemo/example.html)

The technique only requires a GIF file, but I hope you are pleasantly surprised by the quality of animations you can achieve.  You can see a library of sample GIF files here (http://imgur.com/a/NRZVQ) .  You could in theory use any GIF file of a talking character (see the github page for details), but ideally you can use a GIF file with a high quality animation and a special GIF extension that enables independent blink and eyebrow movements.  A future version of our iOS app talkr (http://talkrapp.com) will be able to export these GIF files.  As of now, you can only export movies from talkr which you would have to convert to a normal GIF without independent blink and eyebrow channels.

In any case, I welcome any feedback on the library or the app!  There should be nothing stopping you from bringing your chatbots to any platform that supports TTS in the browser (iOS, Android, Windows, OSX, etc)







*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6088
  • Mostly Harmless
Re: New javascript library for animating Chatbots on the web - talkr
« Reply #1 on: July 29, 2017, 12:02:24 am »
Hi there,

This is a nice system and I look forward to seeing the app being able to export the GIFs that botmasters will need.

In the meantime the example GIFs are still very usable as a bot avatar : http://elfscript.uk/chattygirl.html

What I found really cool was how convincing you made her without having to play with all that phoneme/viseme stuff.

I took the liberty of giving you a forum avatar :)

*

8pla.net

  • Trusty Member
  • *********
  • Terminator
  • *
  • 792
    • 8pla.net
Re: New javascript library for animating Chatbots on the web - talkr
« Reply #2 on: July 29, 2017, 01:26:52 am »
Freddy,

This library works with any GIF animation image.  A gifanim talking (mouth moving) and eyes blinking works best.

New Sample:  http://chatbot.altervista.org/giftts/moretesting.php

However for example, a gifanim of people dancing would vary following different user inputs.



Image Citation: Giphy.com



My Very Enormous Monster Just Stopped Using Nine

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6088
  • Mostly Harmless
Re: New javascript library for animating Chatbots on the web - talkr
« Reply #3 on: July 29, 2017, 02:12:02 am »
I just see a static image there, no animation in Chrome.

She really thinks she can dance doesn't she  ;D

*

bot_animator

  • Roomba
  • *
  • 2
Re: New javascript library for animating Chatbots on the web - talkr
« Reply #4 on: July 29, 2017, 02:21:02 am »
I get the animation when I hit "Chat" on chrome on OSX.   That Rapunzel gif is a good one 8pla.net!  Also, that javascript TTS is a bit faster than the ones I've been using...I would definitely decrease the per-character estimate a tad (line 157 of example.js) from 50 to maybe 40 or so to get a better sync with that TTS. 

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6088
  • Mostly Harmless
Re: New javascript library for animating Chatbots on the web - talkr
« Reply #5 on: July 29, 2017, 02:43:42 am »
Hmm tried it in FF and it did nothing either. Edge really didn't like it again. I think Chrome is up to date here, it should be.

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6088
  • Mostly Harmless
Re: New javascript library for animating Chatbots on the web - talkr
« Reply #6 on: July 29, 2017, 02:45:53 am »
It was a little out of date, but after updating I just see a static image again.

Version 60.0.3112.78 (Official Build) (64-bit)

*

8pla.net

  • Trusty Member
  • *********
  • Terminator
  • *
  • 792
    • 8pla.net
Re: New javascript library for animating Chatbots on the web - talkr
« Reply #7 on: July 29, 2017, 03:23:08 am »
I just got it working under Chrome too now.

i removed some PHP I added for alpha testing to stop page caching.

Code: [Select]
?r=<?=rand(111,999)?>





My Very Enormous Monster Just Stopped Using Nine

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6088
  • Mostly Harmless
Re: New javascript library for animating Chatbots on the web - talkr
« Reply #8 on: July 29, 2017, 03:43:25 am »
That's got it  O0

Working fine now, really good choice of character, she looks crazy !

*

8pla.net

  • Trusty Member
  • *********
  • Terminator
  • *
  • 792
    • 8pla.net
Re: New javascript library for animating Chatbots on the web - talkr
« Reply #9 on: July 29, 2017, 03:52:11 am »
I would definitely decrease the per-character estimate a tad (line 157 of example.js) from 50 to maybe 40 or so to get a better sync with that TTS.

Thank you for your precious feedback.  I decreased the per-character estimate to luck number 38.
My Very Enormous Monster Just Stopped Using Nine

*

8pla.net

  • Trusty Member
  • *********
  • Terminator
  • *
  • 792
    • 8pla.net
Re: New javascript library for animating Chatbots on the web - talkr
« Reply #10 on: July 29, 2017, 03:58:23 am »
That's got it  O0

Working fine now, really good choice of character, she looks crazy !

Thank you Freddy.  It easily worked with several other GIF anims.  And when
it did not work for visemes (lip postures), the results were still fun to watch.
My suggestion is to try it with any of the many GIF anims you can find online.
This library actually works great with this little guy, (talking and blinking)...  :tickedoff:
My Very Enormous Monster Just Stopped Using Nine

 


Users Online

12 Guests, 0 Users

Most Online Today: 34. Most Online Ever: 208 (August 27, 2008, 09:36:30 am)

Articles