Realtime

Realtime

Postby 24pfilms » Sat Aug 13, 2011 11:30 am

Well it sure would be damn cool to speak into a mic on your machine,
and have it transcribe the audio into text, and then have the text
drive the phoneme's to then drive the character mouth."
24pfilms
Trial License
Trial License
 
Posts: 1
Joined: Sat Aug 13, 2011 11:29 am

Re: Realtime

Postby dave » Sat Aug 13, 2011 12:30 pm

Very true. This feature has been suggested by one of our developer license clients as well. Now we just need to start poking Gary in the back to see what the feasibility is in getting it developed.
~Dave
dave
Site Admin
Site Admin
 
Posts: 20
Joined: Thu Jul 21, 2011 9:51 am

Re: Realtime

Postby Lyrical » Sun Aug 14, 2011 8:49 am

That would be a nice feature but not part of the original design idea for iSpeech.

The main problem with iSpeech is that you need to pre-process the audio file with a Text file to get the phoneme data this is then used to create the .Speech.txt file for use in iSpeech.

I think if we got enough sales to get the developer version of the lipsync then we could integrate without the use of the pre-process stage.
From there is just a case of:-
* Read data from mic
* Read Phoneme data from audio
* Add these files into iSpeech or send the data files as a function to iSpeech
- iSpeech.Instance.Speak(Audio,speechfile)

I will keep this in mind for future developments.
thanks for the suggestion.
Last edited by Lyrical on Thu Aug 25, 2011 12:08 pm, edited 2 times in total.
Lyrical
Site Admin
Site Admin
 
Posts: 17
Joined: Tue Aug 09, 2011 1:00 am

Re: Realtime

Postby Rahul » Wed Aug 17, 2011 3:41 am

What is lipsync developer version? where can i found more details?
Rahul
Trial License
Trial License
 
Posts: 3
Joined: Wed Aug 17, 2011 3:39 am

Re: Realtime

Postby dave » Wed Aug 17, 2011 5:42 am

Hi Rahul,

The Developer License gives you unlimited seats, all source code and direct support. See a comparison of license types here: http://www.iongfx.com/comparison.html
~Dave
dave
Site Admin
Site Admin
 
Posts: 20
Joined: Thu Jul 21, 2011 9:51 am

Re: Realtime

Postby Rahul » Wed Aug 31, 2011 7:44 am

Dear Dave,

Thanks for comparison chart.
Actually i was asking about what license Lyrical is talking about to add the mike feature.
I Have a project where i need to create virtual classroom where a teacher can on line interact with students all over the world where students can see talking avatar of teacher and teacher can see talking avatar of student whenever any student puts a question in front of teacher. Here i need real time input of voice and need avatar to lip sync as per that voice. If you people can make a tool for this job let me know, may be I can financially help you to get the required developer license.
If you want we can make some exclusive agreement on it.
Rahul
Rahul
Trial License
Trial License
 
Posts: 3
Joined: Wed Aug 17, 2011 3:39 am

Re: Realtime

Postby Lyrical » Wed Aug 31, 2011 8:38 am

Hey Rahul,

Currently iSpeech is using a lipsync tool that makes the initial phonemes files.
This tool is a console based application and requires our ISpeech File Creator
for it to work.

In order to convert your Microphone data and analyse this for phonemes we would need the developer solftware
of the lipsync software which is pretty expensive.

I'm interested in how you want to use iSpeech There maybe some way a recording of the voice could be done then preprocessed some how
through Unity or external program and then feed the voice and phoneme information into Unity for iSpeech to use. I'm not sure how quick this would
be in terms of realtime. This is an interesting area that i shall continue to look into.
Lyrical
Site Admin
Site Admin
 
Posts: 17
Joined: Tue Aug 09, 2011 1:00 am

Re: Realtime

Postby Lyrical » Wed Aug 31, 2011 8:41 am

Rahul,
If you can think of a possible solution please let me know
i'm always willing to listen to new ideas and will do all i can to help out.
Lyrical
Site Admin
Site Admin
 
Posts: 17
Joined: Tue Aug 09, 2011 1:00 am


Return to Request a Feature

Who is online

Users browsing this forum: No registered users and 1 guest