3D Avatar Project

  • 113 Replies
  • 46134 Views
*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6855
  • Mostly Harmless
3D Avatar Project
« on: September 05, 2014, 05:11:04 pm »
Here's where I am at with my animated head. I've added blinking and eye movement now. The blinking is automatic and the eyes are currently controlled via a slider. Eventually I will work out some noise routine so that the eyes wander realistically.

I'm not completely happy with the hair. Getting the transparency right for that has been the bugbear so far. I mean the layering is not quite right, but I have one idea to try still.

This is a new voice too - 'Jess' from Cereproc.

Most of the recent work has been 'under the skin', quite literally. As I mentioned before somewhere I am now working with a lower poly model. This has meant I can do much more. There's also a bit of optimisation done to the mesh, so that only the parts that need animating are processed. If it doesn't move then I simply display it, but then forget about it.

Animated head - blinking and eye movement
« Last Edit: October 17, 2014, 05:43:06 pm by Freddy »

*

Data

  • Trusty Member
  • ***********
  • Eve
  • *
  • 1279
  • Overclocked // Undervolted
    • Datahopa - Share your thoughts ideas and creations
Re: 3D Avatar Project - Animated Head
« Reply #1 on: September 05, 2014, 08:31:52 pm »
She already sings better than some I've seen on xfactor  ;D

Coming together nicely   O0

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6855
  • Mostly Harmless
Re: 3D Avatar Project - Animated Head
« Reply #2 on: September 05, 2014, 08:42:56 pm »
Thanks mate  :)

I find the bad singers on xfactor more entertaining than the ones who are supposed to be good  >:D

*

squarebear

  • Trusty Member
  • *********
  • Terminator
  • *
  • 867
  • It's Hip to be Square
Re: 3D Avatar Project - Animated Head
« Reply #3 on: September 05, 2014, 10:58:35 pm »
Nice work Freddy. That voice is amazing.
I would love to have something like that to represent Mitsuku instead of a flat 2d drawing.
Feeling Chatty?
www.mitsuku.com

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6855
  • Mostly Harmless
Re: 3D Avatar Project - Animated Head
« Reply #4 on: September 05, 2014, 11:47:15 pm »
Thanks Steve. :)

I'd like to do some web stuff like this but at the moment I don't know how to approach it. I guess WebGL would be one way, but the voices...not sure what to do about that.

There was someone posting some 3D Haptek-like demos on the Knytetrypper forum, I keep meaning to invite them over here.

*

0JL

  • Trusty Member
  • *
  • Roomba
  • *
  • 21
    • thinkbots are free
Re: 3D Avatar Project - Animated Head
« Reply #5 on: September 06, 2014, 03:15:05 pm »
Don't know about the voice-on-web issue, but yes, very nice work! (...and you have good taste)

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6855
  • Mostly Harmless
Re: 3D Avatar Project - Animated Head
« Reply #6 on: September 06, 2014, 03:25:58 pm »
Thank you :)

There is a web solution using Google Translate. But it's not just the voice, it's the phonemes I need too. I do have another option using this open source TTS voice I found called MaryTTS. I can run that on my Linux box. It think it does generate phonemes, but I have yet to look into it that much.

*

mendicott

  • Bumblebee
  • **
  • 28
    • Meta-Guide.com
Re: 3D Avatar Project - Animated Head
« Reply #7 on: September 07, 2014, 01:09:16 am »
> http://www.quora.com/Are-there-any-software-tools-or-APIs-that-will-allow-you-to-create-a-3D-talking-head-that-will-generate-correct-lip-movements-when-given-a-text-stream

See above link for my recent Quora answer to "Are there any software tools or APIs that will allow you to create a 3D talking head that will generate correct lip movements when given a text stream?"

> http://stallios.com/

Since that Quora post I've come across a new player in the space, Stallios Mayca, apparently targeting the high-end => https://www.youtube.com/user/MaycaVideos/

*

Art

  • At the end of the game, the King and Pawn go into the same box.
  • Trusty Member
  • **********************
  • Colossus
  • *
  • 5865
Re: 3D Avatar Project - Animated Head
« Reply #8 on: September 07, 2014, 02:26:02 pm »
Nice but she can't hold a candle to Guile3D's Denise as far as a beautiful, lifelike character. But then again, beauty is rather subjective.

The lip-sync issue has plagued many would be developers in this digital avatar industry but I feel that soon, one day, they'll get it right and it will will work nicely on all platforms. There...that should help brighten everyone's day! Or something like that.... ::)


In the world of AI, it's the thought that counts!

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6855
  • Mostly Harmless
Re: 3D Avatar Project - Animated Head
« Reply #9 on: September 07, 2014, 04:09:29 pm »
Thanks Marcus, but I wasn't really looking for an end product - this is something I am doing for fun and to learn things. Which means I assemble or code it all by myself.

I agree with Art, that Stallios avatar is nice, but the lip-sync is a bit iffy in my humble opinion.

« Last Edit: September 07, 2014, 08:46:31 pm by Freddy »

*

8pla.net

  • Trusty Member
  • ***********
  • Eve
  • *
  • 1302
  • TV News. Pub. UAL (PhD). Robitron Mod. LPC Judge.
    • 8pla.net
Re: 3D Avatar Project - Animated Head
« Reply #10 on: September 08, 2014, 01:14:45 am »
I know the reason for publishing a trial run is to get some useful feedback.  It seems as if the audio track may have been rendered slightly behind the video track by a few tenths of a second.  By looking very closely, the lips may continue to move a fraction of a second after the speech stops.
My Very Enormous Monster Just Stopped Using Nine

*

Art

  • At the end of the game, the King and Pawn go into the same box.
  • Trusty Member
  • **********************
  • Colossus
  • *
  • 5865
Re: 3D Avatar Project - Animated Head
« Reply #11 on: September 08, 2014, 10:05:46 am »
... By looking very closely, the lips may continue to move a fraction of a second after the speech stops.

Yeah...I know of some politicians who exhibit similar behavior!  :2funny:
In the world of AI, it's the thought that counts!

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6855
  • Mostly Harmless
Re: 3D Avatar Project - Animated Head
« Reply #12 on: September 08, 2014, 01:26:36 pm »
Thanks for the observation 8pla. I just tried talking and my lips might still be moving for that fraction of time  ;)

But I know what you mean, I am at the mercy of the tools I play with.

*

8pla.net

  • Trusty Member
  • ***********
  • Eve
  • *
  • 1302
  • TV News. Pub. UAL (PhD). Robitron Mod. LPC Judge.
    • 8pla.net
Re: 3D Avatar Project - Animated Head
« Reply #13 on: September 10, 2014, 10:55:20 pm »
Goes without saying, your trail-run render looks fantastic!  Good point!  Perhaps fine tuning audio skew in a 3D avatar may be more an art than a science.  Please share with me your reasoning.  In other words, and in your opinion, why do the phoneme sounds (the voice) reach the listener before the  physical lip postures are complete (mouth finishes moving) ?   Maybe the speed of sound is a factor, or something?

My Very Enormous Monster Just Stopped Using Nine

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6855
  • Mostly Harmless
Re: 3D Avatar Project - Animated Head
« Reply #14 on: September 10, 2014, 11:19:36 pm »
I don't think it's the speed of sound really over such a short distance. It's probably because my PC can only process the graphical changes at that speed.

I use a decay setting, or in other words I cause it to slowly taper off a morph (lip shape). Perhaps I need to shorten that decay so that the mouth shapes finish more quickly.

Like you observed; it's a trial run, I ain't even remotely finished yet...

 


OpenAI Speech-to-Speech Reasoning Demo
by ivan.moony (AI News )
Today at 01:31:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am
Nvidia Hype
by 8pla.net (AI News )
December 06, 2023, 10:04:52 pm
How will the OpenAI CEO being Fired affect ChatGPT?
by 8pla.net (AI News )
December 06, 2023, 09:54:25 pm
Independent AI sovereignties
by WriterOfMinds (AI News )
November 08, 2023, 04:51:21 am
LLaMA2 Meta's chatbot released
by 8pla.net (AI News )
October 18, 2023, 11:41:21 pm

Users Online

306 Guests, 0 Users

Most Online Today: 346. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles