はいぬっかメモ

キャラクターモデルをVR空間で眺めたい

PerfectSync facial adjustment TIPS

Japanese version

 

This section describes how to adjust the facial expressions of Perfect Sync, focusing on the facial expression data for VRoid included in HANA_Toolv2.9.7a and HANA_APP_v1_1.


HANA_Tool (Unity asset version)

kuniyan.booth.pm

HANA_APP_v1_1 (Windows application version)

booth.pm

HANA_Toolv2.9.7a and HANA_APP_v1_1 are applicable to the VRM models output from VRoid Studio v0.12.1 and v0.13.1.
* Versions prior to VRoidStudio v0.11.3 are not supported because the official default shape keys are less than the latest versions and necessary adjustments such as eye penetration measures and teeth reduction cannot be made.

 

The first letter in upper case refers to the BlendShapeClip in VRM, and the second letter in lower case refers to the BlendShape key to be registered in the Clip.


 

1. eyebrows

-----------------------------------------

Eyebrows are too low and hang over the eyes

Clip to fix: BrowDownLeft / BrowDownRight
Weaken the browDown shape key (the shape key that lowers the eyebrows).

Lumpy eyebrows are too strong and hang over the eyes

Clip to correct: NoseSneerLeft / NoseSneerRight
Weaken the noseSneerLeft/noseSneerRight (shape keys that frown the nose and eyebrows).

Eyebrows are too raised and hidden by the bangs

Clip to fix: BrowInnerUp
Weaken the browInnerUp shape key (the shape key that raises the center of the eyebrows).

When I smile, my eyebrows become a troubled shape

Clip to fix: BrowInnerUp
BrowDownLeft / BrowDownRight
Weaken browInnerUp and browDown at the same time.


2. eyes

-----------------------------------------

Clip to fix: EyeBlinkLeft/EyeBlinkRight
Make sure that the eyeBlinkLeft (left eye closure) / eyeBlinkRight (right eye closure) parameters have not been registered for each Clip.
If they are registered, set them to 0% and register the VRoid default shape keys "EYE_Close_L" and "EYE_Close_R" instead.
If you use ClipBuilder of HANA_Tool, the VRoid default shapekeys will be registered automatically.
The eyeBlinkLeft/eyeBlinkRight (the shape key of the closed eye) added by HANA_Tool is the shape of the template model, Sendagaya Shibu/HairSampleMale.

The eye mesh penetrates the eyelids

Clip to be modified: EyeBlinkLeft/EyeBlinkRight
Add a small amount of the VRoid default "EYE_Iris_Hide" (a shape key that lowers the pupil mesh to the back while shrinking it) to each of the left and right eyes (about 3-5% each).
 In Perfect Sync, the eyeball continues to rotate even when the eyes are closed, which causes frequent penetration for models with large eyes.
 We counteract this by lowering the eyeball by blinking. Be careful not to do too much or you will end up with white eyes.

f:id:hinzka:20210506073139g:plain


Unnatural smiling eyes

Clip to fix: EyeSquintLeft/EyeSquintRight
Weaken the eyeSquint (laughing eye shape key) parameter accordingly, and adjust the arch of the lower eyelid to a natural shape.
At this point, if the entire eye looks unnatural, as if it has been shifted upward
Add eyeDown_Left/eyeDown_Right (shape key to lower the whole eye: HANA_Tool_v2_9_7a included) to balance it out.
It would be a good idea to make sure that the appearance of the iris in the smiling eye is balanced to the same degree as the open eye.

 f:id:hinzka:20210505233804p:plainf:id:hinzka:20210505233818p:plain

Unnatural eye movement when I move my gaze

Clips to fix: EyeLookUpLeft/EyeLookUpRight
     EyeLookDownLeft/EyeLookDownRight
     EyeLookInLeft/EyeLookInRight
     EyeLookOutLeft/EyeLookOutRight
When the eye moves up, down, left, or right, the shape of the eye also changes slightly to give it expression. Depending on the model, this movement may be too large and uncomfortable, and can be improved by reducing each parameter in the clip.

 

Eyes are squinted when eyebrows are moved

Clip to fix: BrowDownLeft/BrowDownRight
     NoseSneerLeft / NoseSneerRight
When the eyebrows are moved using browDownLeft/browDownRight (shape keys for lowering the eyebrows) and noseSneerLeft/noseSneerRight (shape keys for frowning at the nose and eyebrows), the shape of the upper eyelids also changes slightly to add expression.
For some models, this movement may be too much and cause the eyes to break up, which can be avoided by reducing the parameters in the Clip.


Surprise eyes are too exaggerated

Clip to fix: EyeWideLeft/EyeWideRight
     BrowInnerUp
Weaken eyeWideLeft/eyeWideRight (eye widening shape key).
When the eyebrows are raised using browInnerUp (a shape key that raises the center of the eyebrows), the shape of the upper eyelids is also slightly changed to add expression. This can also be weakened as needed. 3.


3. cheeks

-----------------------------------------

How to reshape cheek pukes

Clip to fix: CheekPuff
Adjust the parameters of cheekPuff (the shape key that puffs up the cheeks) to make it moderately full.
If the mouth is too closed and the texture is buried, add a mouth with the VRoid default shape key "MTH_A" to make the buried mouth appear.
In addition, you can make the lips pointy by adding SharpenLips (a shape key to make the mouth pointy: HANA_Tool_v2_9_7a included).
Or, you can add the VRoid default shape key "MTH_Angry" to add an angry expression.
It is also cute to move the mouth up a little with the VRoid default shape key "MTH_Up". 

 

4. mouth

-----------------------------------------

The mouth is vertical.

Clip to fix: MouthPucker
Weaken the parameter of mouthPucker (a shape key that narrows the width of the mouth).
First, check the face in front of you with the mouth open. Adjust the shape of the lips so that they are nicely rounded when they are pursed.
Next, check the profile with the mouth closed, and add SharpenLips (a shapekey to make the mouth pointy: included with HANA_Tool_v2_9_7a) to Clip to make a chew mouth.


The closed mouth will be buried

Clip to fix: MouthClose
  When you add JawOpen (Clip that opens the mouth) and MouthClose (Clip that closes the mouth), you need to adjust them so that the mouth is just closed.
In the MouthClose Clip, once the mouthClose shape key is added, add 100% of the jawOpen shape key at the same time.
Then gradually reduce the MouthClose shape key until the mouth is just closed.
Then return the jawOpen shape key to 0.

The shape of the open mouth is different from the model's original expression.
Clip to be modified: JawOpen
Set the parameter of the shape key jawOpen, which is registered by default, to 0%.
Instead, set the parameter of the VRoid shape key "MTH_A" to 100%.
  At this time, use "MTH_A" as the shape key to adjust MouthClose.

 

To adjust the shape of the mouth when smiling

Clip to be modified: CheekSquintLeft/CheekSquintRight
                                 MouthSmileLeft/MouthSmileRight
 The corners of the mouth of Smile are relatively round, while the corners of the mouth of CheekSquint are relatively sharp.
When each parameter is weakened, the corners of the mouth will drop and the shape of the mouth when smiling will become rounder.
(Even if you weaken the parameters, the corners of the mouth will become sharp if the opening is too small.)

 

I want to stretch my mouth out to the side when I smile.

Clip to correct: CheekSquintLeft / CheekSquintRight
                        MouthSmileLeft/MouthSmileRight
Add MouthWide_Left/MouthWide_Right (shape key for widening the mouth: HANA_Tool_v2_9_7a included) to each of the left and right parameters to widen the mouth horizontally.
The smiling face will become more dynamic and relaxed. Recommended for boys.

 

The mouth of the "O" becomes a trapezoid with a downward expansion.

Clip to correct: MouthStretchLeft/MouthStretchRight
Weaken the mouthStretchLeft/mouthStretchRight (shape keys that adjust the shape of the mouth when the mouth is opened wide).
When the mouth is opened wide, the corners of the mouth also rise. When the mouth is opened wide, the corners of the mouth also rise. This shape key helps to lower the raised corners of the mouth and make the open mouth more rounded.

 

When I open my mouth, my mouth is unnaturally large.

Clip to fix: MouthUpperUpLeft/MouthUpperUpRight

     MouthLowerDownLeft/MouthLowerDownRight

MouthUpperUpLeft/mouthUpperUpRight (shape-key to pull up the upper lip and bare the teeth)
mouthLowerDownLeft/mouthLowerDownRight (shape-keys that pull the lower lip down to bare the teeth)

Weaken each of the following.

 

 

When I squirm, my mouth fills up.

Clips to fix: MouthRollLower/MouthRollUpper
Weaken mouthRollLower and mouthRollUpper, respectively.
Adjust them to keep the mouth closed, even in the gorilla-like mouth state of "Mogu Mogu".
 If the mouth snaps open at this point, the MouthClose parameter may be too weak. If the mouth is puckered up, the MouthClose parameter may be too weak.


When I tie my mouth tightly, my mouth fills up.

Clip to fix: MouthShrugUpper/MouthShrugLower
Weaken the mouthShrugUpper (tightly tied upper lip) and mouthShrugLower (tightly tied lower lip) respectively. 5.


5. tongue

-----------------------------------------

Tongue rotates too far to the side and penetrates the cheek.

Clips to correct: MouthLeft/MouthRignt
Weaken mouthLeft/mouthRight (shape-keys that pull up the corners of the mouth) to suppress the sideways rotation of the tongue.
Leave the TongueOut parameter as it is, as changing the length of the tongue will make it easier to penetrate the lips.


6. teeth

-----------------------------------------

To prevent teeth from being bared.

Clips to be modified: MouthUpperUpLeft/MouthUpperUpRight

       MouthLowerDownLeft/MouthLowerDownRight

MouthUpperUpLeft/mouthUpperUpRight (shape key to pull up the upper lip and bare teeth)
mouthLowerDownLeft/mouthLowerDownRight (shape-keys that pull the lower lip down to bare the teeth)

Weaken each of the following

 

 

Want to make the teeth less visible when the mouth is open.

Clip to be modified: JawOpen

Add 100% of the VRoid default shape key "HA_Short".

 

 

To make the teeth invisible

(1) Use a texture to make them disappear (it is possible to make them disappear without fail).
 In the png file of the mouth texture image, delete the teeth part and make it a transparent png.
 In Unity, set the material as follows to prevent the transparent part from being drawn.
  Shader:VRM/Mtoon Rendering Type:CutOut Cull Mode:Back

(2) Hiding with BlendShape
 Add 100% of the VRoid default shape key "HA_Short" to each of the following Clips.
JawOpen
MouthSmileLeft
MouthSmileRight
MouthFunnel (Additional. If you add this to the Clip, you will not be able to see the teeth even in the case of Sasis Seso.


7. real side face movement series

-----------------------------------------

Improvement of tracking in general

Make the lighting in the room brighter. When using a handheld light, be careful not to cast a shadow on the face. When using a handheld light, be careful not to cast a shadow on the face, as strong light shining at an angle will cast a strong shadow on the nose.
If your hair hangs over your face, fasten it with hairpins. If your eyebrows are hidden by the bangs, you cannot track them.


How to make mouth frown

If you close your mouth tightly and lower the corners of your mouth, you can make mouth frown.
(When the mouth is open, mouthFrown (the shape key that lowers the corners of the mouth) has almost no effect.


How to make a tongue flap

With your mouth closed, stick out your tongue from your closed lips and stretch it out to the left or right as far as you can to make a tongue flap.
It is difficult to recognize the tongue movement in the dark, so if this does not work, try brightening the room.


Frowning your eyebrows

To make a lumpy eyebrow, put pressure between your eyebrows, as if you were wrinkling your nose.

Translated with www.DeepL.com/Translator (free version)