Before embarking on the challenge of becoming a VTuber, many people hesitate due to the perception that it requires specialized knowledge of 3D modeling and engines. However, with the recent development of various software, you can become a VTuber without expensive equipment or engineering skills.

We will introduce software necessary to become a VTuber. But before that, if you’re still contemplating what type of virtual VTuber you want to be, check out the following article first!

Two key elements for setting up a VTuber concept

[Contents]

  1. Essential knowledge for VTubers
  2. Software for VTubers
  3. Motion capture devices
  4. Conclusion

1. Essential knowledge for VTubers

First, let’s simplify the terminology related to 3D modeling:

  • Modeling: Creating the shape of a 3D object, where the created structure is referred to as “mesh.”
  • Texturing: Manipulating the material of a 3D object. Textures are stored as image files, such as tga. Applying textured images onto the model helps represent the material properties.
  • Rigging: Constructing the skeleton of a 3D object and placing it in the appropriate positions for connectivity. Rigging is necessary for enabling movement, especially for 3D characters.
  • Facial: Rigged elements that allow the expression of facial movements for a 3D character.
  • FBX, OBJ: Common file formats for 3D objects. There are various extensions depending on the modeling tool used.
  • VRM: One of the file extensions for 3D avatar files. VRM files can contain all the data related to 3D avatars, including textures and rigging. They can be imported into different engines and software for use.
  • Tracking: The process of capturing and synthesizing digital information corresponding to movements using image sensors (such as cameras or dedicated devices) and displaying it on a screen. In the context of VTuber content, tracking refers to capturing human expressions and movements.

2. Software for VTubers

Here are some VTuber software options. If you have a 3D model with rigging, you can leverage a variety of software to engage in VTuber activities. By adding additional devices or software, you can achieve higher-quality tracking capabilities.

SoftwarePriceMotion capture capability and devicesFile format
Facial captureMotion capture
MeligoFree / Enterprise pricingiPhone requiredPossible with VR equipmentVRM
VRChatFreeVR device requiredPossible with VR equipemntVRM
HitogataFreeWebcam requiredXFBX, VRM
VSeeFaceFreeWebcam or iPhone requriedLeap motion (hands and fingers)VRM, VSFAvatar
MimojiFreeiPhone requiredXInternal file
MeechuEnterprise pricingiPhone requiredBetaVRM
VTube StudioFree / $14.99 (Remove Watermark)Webcam or Android requiredWebcam (hand tracking)Live 2D
AnimazeFree ~ $99.99/YearWebcam requiredPossible with AR/VR quipementVRM
ActionmanFree / Enterprise pricingWebcam or Mobile cam requiredWebcam or Mobile cam requiredVRM, GLB
(2023.06 기준)

3. Motion capture devices

To apply the movements of a broadcaster to a 3D avatar, various motion capture devices are required. Let’s take a look at facial tracking (facial recognition) and body tracking (movement recognition) separately. Here are some commonly used tracking devices:

Facial Tracking:

  • Webcam / iPhone: Typically, facial tracking can be done using a webcam or the Face ID feature on an iPhone.

Body Tracking:

  • To capture the movements of different body parts more accurately, additional equipment is needed. Two prominent equipment companies in this field are Vive and Meta’s Oculus. For body tracking, you need to attach trackers, which can detect movements of various body parts such as upper body, lower body, and joints. Attaching motion capture devices to all body parts, including the upper body, lower body, and joints, is known as full-body tracking.
  • Vive: Provides various trackers and base stations specifically designed for VTubers. The more trackers and base stations you have, the more precise and smooth your movements can be.
    • Trackers: The trackers can be attached to the body to track its movements.
    • Base Station: It is required to accurately track the position of VIVE trackers.
Vive 트래커
버튜버-Vive 트래커
(Vive Tracker 2.0 / Source: Vive)
베이스 스테이션
(Vive’s Base Station 1.0 / Source: Vive)

  • Oculus Quest: It is used to implement simple movements such as head and hand movements. It is mostly used to experience the sense of space in VR Chat or VR games rather than for VTubers.
오큘러스 퀘스트
(Oculus Quest/ Source: Meta)

Advanced motion capture devices:

  • Neuron: It is a high-performance motion capture device that allows for more precise expression of movement in 3D characters, making it highly effective for VTubers with high-resolution graphics.
Neuron의 전신 트래킹 기기
(Neuron’s full body tracker / Source: Neuron)

One notable VTuber who utilizes advanced motion capture equipment for body tracking is Codemiko. Codemiko showcases high-quality graphics and tracking by utilizing the Unreal Engine and full-body motion capture devices. It is quite famous that Codemiko incurred a debt of $20,000 to acquire the necessary motion capture equipment for broadcasting.

To achieve a similar level of quality as Codemiko or other VTubers, it requires extensive research and support. Youna Kang, who portrays Codemiko, also had experience working as a 3D designer and VR artist, which facilitated her ability to produce high-quality virtual content.

풀바디 모션 캡쳐 장비를 소개하는 코드미코
(Codemiko introduced full-body motion captures / Source: Codemiko‘s Youtube channel)

Using such expensive motion capture equipment not only requires a significant financial investment but also demands specialized knowledge and technical expertise, making the entry barrier quite high. As a result, these devices are more commonly used in advertising and film production rather than for VTubers.

아바타 영화
영화 아바타
(The movie ‘Avatar’ / Source: Weta Digital)

Others:

Some software may only be compatible with specific tracking devices. For instance, in the case of VTuber software, Meligo requires the purchase and use of Fee the Same’s tracking equipment if you want to enable body tracking.

멜리고에서 사용할 수 있는 Feel the Same 트래킹 장비
(Feel the Same‘s tracker / Source: Meligo)

4. Conclusion

With the recent development of various software options for virtual content creation, it has become possible for aspiring VTubers to engage in activities without the need for expensive motion capture equipment. There are now a wide range of software available in the market that caters to different price ranges, tracking capabilities, and supported file formats. Consider exploring suitable software based on your desired price range, capture capabilities, and supported file formats.

While using motion capture devices can enhance the level of realism and enable more sophisticated character expressions, it’s important to note that these devices often come with a high price tag, making them more commonly used in advertisements and movies rather than by VTubers. If you are just starting out as a VTuber, it is recommended to begin with software that supports tracking capabilities and then, based on your growth and strategic needs, consider investing in motion capture equipment in the future.

In the virtual world, we can be anyone and do anything.
Wondervari is here to help any individual have a better life by actualizing their imagination in a virtual world.

hummit.co

Share post: