はいぬっかメモ

キャラクターモデルをVR空間で眺めたい

PerfectSync facial adjustment TIPS

Japanese version

 

This section describes how to adjust the facial expressions of Perfect Synth, using a sample file created with the official version of VRoid's VRM as an example.

f:id:hinzka:20211125234842p:plain

Sample VRM models are available here.

github.com

 

The following entry summarizes the facial expressions on the real side, which are the target of tracking.

hinzka.hatenablog.com

 

 

The official version of VRoid Studio can be copied from both male and female data.

If you want to move the jaw firmly, the male version of the data is recommended.
The male version is recommended for models with a large "Mouth Width" setting.  
The female version is recommended for models with a small "Mouth Width" setting.

f:id:hinzka:20211221112204p:plain

 

The first letter in upper case refers to the BlendShapeClip in VRM, and the second letter in lower case refers to the BlendShape key to be registered in the Clip.


 

1. eyebrows

-----------------------------------------

Eyebrows are too low and hang over the eyes

Clip to fix: BrowDownLeft / BrowDownRight
Weaken the browDown shape key (the shape key that lowers the eyebrows).

Lumpy eyebrows are too strong and hang over the eyes

Clip to correct: NoseSneerLeft / NoseSneerRight
Weaken the noseSneerLeft/noseSneerRight (shape keys that frown the nose and eyebrows).

Eyebrows are too raised and hidden by the bangs

Clip to fix: BrowInnerUp

                    browOuterUpLeft/browOuterUpRight
Weaken the browInnerUp shape key (the shape key that raises the center of the eyebrows).

At the same time, weaken browOuterUpLeft/browOuterUpRight (shape-keys that raise the ends of the eyebrows).

 

When I smile, my eyebrows become a troubled shape

Clip to fix: BrowInnerUp
                    browOuterUpLeft/browOuterUpRight
Weaken browInnerUp (the shape key for troubled eyebrows) and at the same time weaken browOuterUpLeft/browOuterUpRight (the shape keys for raised eyebrows).


These shapes will create a "naturally raised eyebrow(=Surprised eyebrows)" shape when combined.

f:id:hinzka:20211222071857g:plain(browInnerUp+browOuterUp)

If you weaken browInnerUp, you need to weaken browOuterUpLeft/browOuterUpRight at the same time.
As a result, if the eyebrows are not raised enough when you are surprised, add the VRoid default Fun/Joy eyebrows (a shape that raises the entire left and right eyebrows) to BrowInnerUp and adjust them.


2. eyes

-----------------------------------------

Clip to fix: EyeBlinkLeft/EyeBlinkRight
Make sure that the original model's own closing shape key is set.
If the correct shape is registered, there may be a problem with the tracking environment. See Improvement of tracking in general.

.

The eye mesh penetrates the eyelids

Clip to be modified: EyeBlinkLeft/EyeBlinkRight
Add a small amount of the VRoid default "Fcl_EYE_Iris_Hide" (a shape key that lowers the pupil mesh to the back while shrinking it) to each of the left and right eyes (about 3-5% each).
 In Perfect Sync, the eyeball continues to rotate even when the eyes are closed, which causes frequent penetration for models with large eyes.
 We counteract this by lowering the eyeball by blinking. Be careful not to do too much or you will end up with white eyes.

f:id:hinzka:20210506073139g:plain


Unnatural smiling eyes

Clip to fix: EyeSquintLeft/EyeSquintRight
Weaken the eyeSquint (laughing eye shape key) parameter accordingly to make the arch of the lower eyelid look more natural.

 

Unnatural eye movement when I move my gaze

Clips to fix: EyeLookUpLeft/EyeLookUpRight
     EyeLookDownLeft/EyeLookDownRight
     EyeLookInLeft/EyeLookInRight
     EyeLookOutLeft/EyeLookOutRight
When the eye moves up, down, left, or right, the shape of the eye also changes slightly to give it expression. Depending on the model, this movement may be too large and uncomfortable, and can be improved by reducing each parameter in the clip.

 

Eyes are squinted when eyebrows are moved

Clip to fix: BrowDownLeft/BrowDownRight
     NoseSneerLeft / NoseSneerRight
When the eyebrows are moved using browDownLeft/browDownRight (shape keys for lowering the eyebrows) and noseSneerLeft/noseSneerRight (shape keys for frowning at the nose and eyebrows), the shape of the upper eyelids also changes slightly to add expression.
For some models, this movement may be too much and cause the eyes to break up, which can be avoided by reducing the parameters in the Clip.


Surprise eyes are too exaggerated

Clip to fix: EyeWideLeft/EyeWideRight
     BrowInnerUp
Weaken eyeWideLeft/eyeWideRight (eye widening shape key).
When the eyebrows are raised using browInnerUp (a shape key that raises the center of the eyebrows), the shape of the upper eyelids is also slightly changed to add expression. This can also be weakened as needed. 3.


3. cheeks

-----------------------------------------

How to reshape cheek pukes

Clip to fix: CheekPuff
Adjust the parameters of cheekPuff (the shape key that puffs up the cheeks) to make it moderately full.
If the mouth is too closed and the texture is buried, add a mouth with the VRoid default shape key "MTH_A" to make the buried mouth appear.
In addition, you can make the lips pointy by adding SharpenLips (a shape key to make the mouth pointy: HANA_Tool_v2_9_7a included).
Or, you can add the VRoid default shape key "MTH_Angry" to add an angry expression.
It is also cute to move the mouth up a little with the VRoid default shape key "MTH_Up". 

 

4. mouth

-----------------------------------------

The mouth is too wide to collapse

Modify Clip: JowOpen MouthClose

 

Jaw Open and Mouth Close need to be adjusted as a set.

In JawOpen, weaken the parameters of jawOpen (shape key that opens the jaw and mouth).  * Please remember the values ​​at this time.

In addition, add Fcl_MTH_Small and Fcl_MTH_Large (both are VRoid default shape keys) and adjust them so that they open nicely and roundly when you open your mouth wide.

Then, in the MouthClose clip, set the mouthClose parameter to "the same number as the jawOpen number set in the JawOpen clip".

 

 

The mouth is vertical.

Clip to fix: MouthPucker
Weaken the parameter of mouthPucker (a shape key that narrows the width of the mouth).
Adjust the shape of the lips so that they are nicely rounded when they are squeezed.

If the mouthPucker parameter is maximized but the narrowing is still insufficient, you can add the VRoid default Fcl_MTH_Small (a shapekey to narrow the mouth) to narrow it.


The closed mouth will be buried

Clip to fix: MouthClose
Set the parameters for JawOpen (Clip to open the mouth) and MouthClose (Clip to close the mouth) to be the same.

 want to reshape my open mouth.

Clip to fix: JawOpen

JawOpen parameters, and
Fcl_MTH_Small (shape key to narrow the width of the mouth)
Fcl_MTH_Large (shape key to increase the width of the mouth)
to adjust the mouth opening.

 

To adjust the shape of the mouth when smiling

Clip to be modified: CheekSquintLeft/CheekSquintRight
                                 MouthSmileLeft/MouthSmileRight
 The corners of the mouth of Smile are relatively round, while the corners of the mouth of CheekSquint are relatively sharp.
When each parameter is weakened, the corners of the mouth will drop and the shape of the mouth when smiling will become rounder.
(Even if you weaken the parameters, the corners of the mouth will become sharp if the opening is too small.)

 

I want to stretch my mouth out to the side when I smile.

Clip to correct: CheekSquintLeft / CheekSquintRight
                        MouthSmileLeft/MouthSmileRight
Adding the VRoid default Fcl_MTH_Large (a shape key that increases the width of the mouth) to each of the left and right parameters makes the mouth widen horizontally.
The smiling face becomes more dynamic and relaxed. This is recommended for boys.

 

The mouth of the "O" becomes a trapezoid with a downward expansion.

Clip to correct: MouthStretchLeft/MouthStretchRight
Weaken the mouthStretchLeft/mouthStretchRight (shape keys that adjust the shape of the mouth when the mouth is opened wide).
When the mouth is opened wide, the corners of the mouth also rise. When the mouth is opened wide, the corners of the mouth also rise. This shape key helps to lower the raised corners of the mouth and make the open mouth more rounded.

 

When I open my mouth, my mouth is unnaturally large.

Clip to fix: MouthUpperUpLeft/MouthUpperUpRight

     MouthLowerDownLeft/MouthLowerDownRight

MouthUpperUpLeft/mouthUpperUpRight (shape-key to pull up the upper lip and bare the teeth)
mouthLowerDownLeft/mouthLowerDownRight (shape-keys that pull the lower lip down to bare the teeth)

Weaken each of the following.

 

 

When I squirm, my mouth fills up.

Clips to fix: MouthRollLower/MouthRollUpper
Weaken mouthRollLower and mouthRollUpper, respectively.
Adjust them to keep the mouth closed, even in the gorilla-like mouth state of "Mogu Mogu".
 If the mouth snaps open at this point, the MouthClose parameter may be too weak. If the mouth is puckered up, the MouthClose parameter may be too weak.


When I tie my mouth tightly, my mouth fills up.

Clip to fix: MouthShrugUpper/MouthShrugLower
Weaken the mouthShrugUpper (tightly tied upper lip) and mouthShrugLower (tightly tied lower lip) respectively. 5.


5. tongue

-----------------------------------------

Tongue rotates too far to the side and penetrates the cheek.

Clips to correct: MouthLeft/MouthRignt
Weaken mouthLeft/mouthRight (shape-keys that pull up the corners of the mouth) to suppress the sideways rotation of the tongue.
Leave the TongueOut parameter as it is, as changing the length of the tongue will make it easier to penetrate the lips.


6. teeth

-----------------------------------------

To prevent teeth from being bared.

Clips to be modified: MouthUpperUpLeft/MouthUpperUpRight

       MouthLowerDownLeft/MouthLowerDownRight

MouthUpperUpLeft/mouthUpperUpRight (shape key to pull up the upper lip and bare teeth)
mouthLowerDownLeft/mouthLowerDownRight (shape-keys that pull the lower lip down to bare the teeth)

Weaken each of the following

 

 

Want to make the teeth less visible when the mouth is open.

Clip to be modified: JawOpen

Add 100% of the VRoid default shape key "Fcl_HA_Short".

 

 

To make the teeth invisible

(1) Use a texture to make them disappear (it is possible to make them disappear without fail).
 In the png file of the mouth texture image, delete the teeth part and make it a transparent png.

# For VRoid Studio β:

#  In Unity, set the material as follows to prevent the transparent part from being drawn.
#  Shader:VRM/Mtoon Rendering Type:CutOut Cull Mode:Back

(2) Hiding with BlendShape
 Add 100% of the VRoid default shape key "Fcl_HA_Short" to each of the following Clips.
JawOpen
MouthSmileLeft
MouthSmileRight
MouthFunnel (Additional. If you add this to the Clip, you will not be able to see the teeth even in the case of Sasis Seso.


7. real side face movement series

-----------------------------------------

The following entry summarizes the facial expressions on the real side, which are the target of tracking.

hinzka.hatenablog.com

Improvement of tracking in general

Make the lighting in the room brighter. When using a handheld light, be careful not to cast a shadow on the face. When using a handheld light, be careful not to cast a shadow on the face, as strong light shining at an angle will cast a strong shadow on the nose.
If your hair hangs over your face, fasten it with hairpins. If your eyebrows are hidden by the bangs, you cannot track them.


How to make mouth frown

If you close your mouth tightly and lower the corners of your mouth, you can make mouth frown.
(When the mouth is open, mouthFrown (the shape key that lowers the corners of the mouth) has almost no effect.

 

How to make a mouth like a peanut

Without raising the corners of your mouth, open your lips firmly and make a "" mouth shape.

 


How to make a tongue flap

With your mouth closed, stick out your tongue from your closed lips and stretch it out to the left or right as far as you can to make a tongue flap.
It is difficult to recognize the tongue movement in the dark, so if this does not work, try brightening the room.


How to frown your eyebrows

To make a lumpy eyebrow, put pressure between your eyebrows, as if you were wrinkling your nose.

Translated with www.DeepL.com/Translator (free version)

 

How to make eyebrows sad 

Lift the middle of the eyebrow (between the eyebrows) to frown. Do not lift the ends of your eyebrows.

 

How to raise the entire eyebrow

Lift the center of the eyebrow and the end of the eyebrow at the same time.