Discord: Start an Activity
How to level up the team spirit in your company!
Sehr toller Beitrag und hammer Gestaltung.
The technology behind the VStreaming trend
Hard- & Software
Introduction
The Japanese VStreaming and VTubing trends have become a global phenomenon in recent years and are attracting more and more viewers and views on social media. Niko, the founder of Studio Merkas, is convinced that anyone can get involved in this topic and become a VStreamer themselves. In this article, we will first look at the origins of the trend and explain the process of creating two-dimensional and three-dimensional avatars. Furthermore, it will be clarified which software and hardware is required for the realization of VStreaming software. Finally, established VStreamers are presented.
VStreaming - The technology behind the trend
The trend from Japan has now also arrived in Germany. VStreaming and VTubing stand for “virtual streaming” and “virtual YouTubing” respectively. This refers to people who create content online with the help of a virtual avatar. These avatars are often reminiscent of anime characters, but it is also possible to animate a photorealistic 3D model.
The big advantage for the creator is that their identity is kept secret and they can still add a personal touch to their videos and/or streams. This has the advantage that the creator can present themselves as they wish, even with a large audience. The creator does not have to worry about their privacy. A 2D or 3D avatar can be used for this.
2D avatar - drawing of a body
For a two-dimensional avatar, the entire body must first be drawn frontally. The creator can do this himself in a 2D drawing program such as "Adobe Photoshop“ or “Gimp” or have it done on commission. When drawing, you should pay attention to which parts of the body should later move individually. These must be drawn separately on their own layers. This includes, for example, individual strands of hair, legs or the eyes.
Apart from that, there are no limits to creativity.
Once the 2D model has been illustrated, it only needs to be rigged. This means that the drawing is provided with a kind of digital skeleton to enable the animations. The “Live2D Cubism” software is used for this process.
In “Live 2D”, the individual layers of the drawing can be assigned to the real body parts. Meshes must then be created to match the body parts. “Live 2D” offers an automatic mesh function for this purpose.
The interface of “Live2D Cubism” with an example model
These meshes can then be used to deform or “warp” the various objects. The rotation of the neck and the breathing of the avatar can also be displayed.
This is followed by the actual rigging. For this, the program specifies where the axes of movement are located. This means that even the behavior of individual strands of hair can be controlled and accessories such as hats can be rigged.
In order to start the actual streaming, the rigged figure is brought to life in a program such as “PrPrLive. With the help of the software, animations can be integrated and played with certain shortcuts.
3D avatar - model of a body
A program such as “VRoid” is the best option for creating a 3D avatar. Here, the creator can assemble their figure in a similar way to creating a character in a video game. However, it is also possible to implement your own models or change individual textures. However, if you do not want to create a classic anime character, it is possible to create a model in “Blender” or other common 3D software. However, the model needs bones to be able to move later. It is also possible to create your own animations here, which can be played using a shortcut. In the end, a three-dimensional model of the avatar should be available in the form of a VRM file.
To bring the avatar to life, the creator needs a tracking program such as “VSeeFace”. The program is free and offers an easy introduction for beginners.
In “VSeeFace” it is possible to control the facial expressions and gestures of your character. In addition, the images of the various emotions can be customized using different presets. It is also possible to implement a light effect that appears like an aura around the avatar.
If no webcam is available, the virtual camera function is helpful. In this mode, the mouth is only tracked using the microphone; the avatar's head does not move.
If the 3D avatar is fully configured, it can be used as a virtual facecam using the transparency setting.
MetaHumans Creator by Unreal Engine
Another tool for creating virtual, photorealistic characters is the “MetaHuman Creator” from Epic Games. In this program, the user selects one of several ready-made models, which they then customize according to their own ideas. The MetaHuman Creator also offers the option of mixing several models to create a completely new character.
In addition, the level of detail of the model can be changed if, for example, a retro look is desired.
The program is very beginner-friendly, but overall the “MetaHuman Creator” does not offer too many options for personalizing an avatar. If you still want to use it, you will need an Epic Games and a Quixel Bridge account. VStreaming with a model from the “MetaHuman Creator” also requires a very powerful computer.
Required hardware
Everything needed for a VStreaming solution is a webcam or smartphone and the appropriate software on a powerful computer. There are also free options for this, such as the program "VSeeFace." If gestures are to be transmitted in addition to facial expressions, a "Leap Motion" device is necessary, which can be somewhat costly depending on the quality. If the creator wants to take VStreaming to the next level, they can use a motion capture suit, which allows for full-body tracking.
Our experiences with VStreaming
In the past, we created the avatar for the German streamer "Torro” and set up his VStreaming. "Torro" streams primarily "Rust" for around 73,000 followers: His avatar is a replica of his character from the video game.
How much does a VStreaming solution cost?
Webcams and microphones are available today in all conceivable price ranges. Depending on the budget, you can find a suitable solution. The better the quality desired, the more budget should be allocated.
If licenses for tracking software are too expensive for the creator, there are also free options. Several free tracking software programs can be downloaded from Steam.
The most essential part, of course, is the avatar. The cheapest option is to create it yourself. However, for those who do not have the means to do so, significantly more money should be planned. Anyone with further questions is welcome to contact the studio for a non-binding consultation.
For high-quality model transmission, a powerful PC is necessary. The software requirements should be considered. Streaming via a console is generally not recommended.
Well-known VStreamers
With over 870,000 followers on Twitch, CodeMiko is one of the most well-known VStreamers. She uses an XSens suit for her setup, which is captured using the Unreal Engine. In 2020, she went viral after showing a side-by-side clip of her recording and her animated 3D model.
Ironmouse is very popular with her 1.1 million followers on Twitch. She became known for her reaction and gaming streams.
AiAngel uses a realistic 3D model for her streams. She primarily does reaction content. On Twitch, she has around 53,000 followers, and on YouTube, nearly 750,000 subscribers.
Conclusion
The VStreaming trend is more popular than ever and represents a global phenomenon. More and more creators are taking advantage of the opportunity to maintain their identity while still giving their content a personal touch or even stepping into another role.
The avatar can embody anything that the imagination desires.
Questions & Wishes
Thank you for your interest in our project. We would love to hear from you if you have any questions, concerns or the like about our game development project. Your feedback is important to us, and we appreciate any input, so please don't hesitate to contact us!
By answering all your questions, we also want to make sure that you have enough insight into our game development process to get a clear picture of how we work. Transparency makes it easier for us to work together on an equal footing. Otherwise, feel free to take a look at our FAQ section. We thank you for your interest in our project and look forward to hearing from you soon!
An overview of virtual reality (VR)
VR attractions are special facilities where visitors can have immersive virtual reality experiences. In this article, we will focus primarily on…
An Overview of Fighting Games
This article is intended to explain the term fighting game and list some examples of well-known fighting games.
Write comment