https://wiki.blender.jp/index.php?action=history&feed=atom&title=Dev%3ARef%2FRequests%2FLipSync 2026-08-02T06:33:10Z このウィキのこのページに関する変更履歴 MediaWiki 1.31.0 https://wiki.blender.jp/index.php?title=Dev:Ref/Requests/LipSync&diff=53980&oldid=prev 2018-06-28T17:51:08Z

<p>1版 をインポートしました</p> <table class="diff diff-contentalign-left" data-mw="interface"> <tr class="diff-title" lang="ja"> <td colspan="1" style="background-color: #fff; color: #222; text-align: center;">← 古い版</td> <td colspan="1" style="background-color: #fff; color: #222; text-align: center;">2018年6月28日 (木) 17:51時点における版</td> </tr><tr><td colspan="2" class="diff-notice" lang="ja"><div class="mw-diff-empty">(相違点なし)</div> </td></tr></table>

Yamyam https://wiki.blender.jp/index.php?title=Dev:Ref/Requests/LipSync&diff=53979&oldid=prev 2009-02-09T02:04:41Z

<p><a href="/Dev:Ref/Requests/lipSync" class="mw-redirect" title="Dev:Ref/Requests/lipSync">Dev:Ref/Requests/lipSync</a> moved to <a href="/Dev:Ref/Requests/LipSync" title="Dev:Ref/Requests/LipSync">Dev:Ref/Requests/LipSync</a>: typo</p> <p><b>新規ページ</b></p><div>==Introduction==<br /> We are four students interested in developping a new feature in blender3d. We all know C/C++ programming and 3d design. We plan to integrate a lip-sync interface in blender (inspired by software such as papagayo or Jlip-sync). The first steps of our project were supervised by our university but we are still working on it after the study term. <br /> <br /> Our target is to provide an user friendly interface to support the lip sync process using audio file and text as input.<br /> <br /> Our first idea has been discussed on IRC #BlenderCoders and we have made some change to the project according to what we have been told. The discussion can be viewed here: [http://marc.gardent.free.fr/files/blendercoders250207.html IRC #BlenderCoders 25/02/2007(about lip sync)]<br /> <br /> We have already experimented lip-sync with papagayo: [http://marc.gardent.free.fr/videos/lipsync.swf lipsync.swf]<br /> <br /> You can send your suggestions to [http://www.blender.org/forum/viewtopic.php?p=60108#60108 blender forum] or by mail [mailto:sharpTeam38@yahoo.com sharpTeam38@yahoo.com].<br /> <br /> ==Progress==<br /> <br /> 12 june 2007 :<br /> * The animation is made using action strips instead of only shape keys<br /> * The strips representing the sentences, words and phonemes can be moved and resized<br /> <br /> 6 may 2007:<br /> * The text entered by the user is broken down into sentences, words and then phonemes<br /> * Sentences, words, and phonemes are dispayed in strips<br /> <br /> 22 march 2007 :<br /> * [http://marc.gardent.free.fr/files/Lipsync-Documentation.pdf university documentation (pdf)]<br /> * Starting implementation<br /> * Phonemes are retrieved from the dictionary<br /> * A new space for the lip-sync editor has been added<br /> <br /> <br /> <br /> ==Lip sync proposal==<br /> <br /> Here is the current state of our project,<br /> we have made several changes since our draft proposal :<br /> <br /> <br /> We have decided to use actions for the animation to allow everyone to use his own rigging (shape actions, driven shape keys, lattices...)<br /> <br /> Interface has changed as well, indeed, we are not using panels any more. The lipsync editor will allow the user to create a new project, load text and sound and access a mapping editor where the user would be able to link phonemes to actions.<br /> <br /> ===GUI===<br /> <br /> [[Image:lipsyncBeta.jpg|center|thumb|640px|lip sync GUI]]<br /> <br /> <br /> ==Video==<br /> <br /> A temporary demo of our current progress<br /> <br /> We have just created few shapes to show what's our project about. The mapping editor is missing for now and many things are under development.<br /> <br /> click right &gt;&gt; &quot;save target as&quot; , and open it with VLC:<br /> http://discoveryblender.tuxfamily.org/lipsync-wip-demo.mov<br /> <br /> ==Workflow==<br /> <br /> * Create several actions for the mesh to animate<br /> * Add a new &quot;lip sync project&quot; from the lipsync editor listbox<br /> * Load an audio file<br /> * Load or type a text<br /> * Click on the &quot;process&quot; button<br /> * Adjust timing in the lipsync editor (move and resize strips according to the audio) <br /> * Load the mapping editor <br /> * Create a new &quot;mapping project&quot; from the mapping editor listbox<br /> * Link phonemes to actions from the mapping editor<br /> <br /> <br /> ==Lip sync draft (march)==<br /> <br /> This was our first draft for the project :<br /> <br /> <br /> <br /> We plan to integrate our interface in a new editor : lip-sync editor.<br /> <br /> We have chosen to use the text editor so a text could be loaded from the hard drive or typed by user easily.<br /> <br /> Features:<br /> <br /> * Phonemes will be created according to the text loaded with the audio file. Then user will be able to synchronize it by moving the words. <br /> <br /> * Each phoneme could be linked to several shapes by user: For each phoneme user would be allowed to choose a percentage of each shape key he has created so far. For instance a &quot;Ai&quot; phoneme could be a combination of 50% of shape 1, 25% of shape 2, etc<br /> So the more the user create shapes, the more the animation will be detailled but only few shapes will be needed to make it.<br /> <br /> ===GUI===<br /> <br /> [[Image:lip-sync-draft-2.jpg|center|thumb|640px|lip sync GUI]]<br /> <br /> <br /> ====References====<br /> * 1 Open/change lip-sync project<br /> * 2 Load audio file<br /> * 3 Load text input from the text editor<br /> * 4 Open/change mapping phoneme<br /> * 5 Select a phoneme from those produced by the text analysis<br /> * 6 For the phoneme selected, choose a percentage of each shape key created<br /> <br /> ====Shortcuts in action editor====<br /> * L key: change language linked to selected word or sentence.<br /> <br /> <br /> ==Resources==<br /> [http://www.annosoft.com/phoneset.htm Information on converting phonemes to visemes]<br /> <br /> <br /> http://forums.polyloop.net/tutoriaux-carrara/4607-c5-rigging-skinning-bones-deformations.html <br /> <br /> [http://web.alfredstate.edu/ciat/tutorials/FacialExpressions.htm Blend Shape under Maya]<br /> <br /> <br /> ===lip sync software===<br /> <br /> http://www.annosoft.com/sapi_lipsync.htm<br /> http://www.lostmarble.com/papagayo/index.shtml<br /> <br /> http://users.monash.edu.au/~myless/catnap/<br /> http://jlipsync.sourceforge.net/<br /> http://yolo.sourceforge.net/<br /> http://www.thirdwishsoftware.com/magpie.html<br /> http://www.thirdwishsoftware.com/magpiepro.html<br /> <br /> http://www.inria.fr/rapportsactivite/RA2005/parole/uid45.html</div>

wiki>Mindrones