We are always tracking technique on interactive, for example force feedback
wheel of race game, or speech recognize in 3d navigation. When Kinect is
available, we think we can use it as input device and modeling utility and
motion capture device. Modeling and animation of 3D Avatar is expensive, Kinect
will reduce our cost for build multi-user 3D world and make that move lively.
We have done many
plug-in base on OpenNI. In last year OpenNI are using MS Kinect SDK driver,
and OpenNI is purchased by Apple. Then we decide to using MS Kinect. We have
moved our code to MS Kinect SDK now.
The newer utility will use Kinect and X3D H-anim to make 3D production and web-base 3D
application.
Our utility design to:
Product low polygon model with texture and skin weight setting.
Capture animation.
View, test, share in web browser and/or pre-defined multi-user 3d
environment.
Can be used for webpage based 3D game or other application, even without
web browser plug-in.
Can exchange 3D model and animation to other software, can use 3ds MAX
as animation and skin weight editor.
X3D is XML-ized standard, integration with other applications is
easy.
Faster and cheaper
X3D (ISO/IEC 19775:2006) strives to become the 3D standard for the Web.
X3D defined <X3D></X3D> tags and other nodes for HTML5.
X3D has demonstrated how to integrate 3D and HTML with a browser plugin, or with only WebGL and JavaScript.
Humanoid Animation (ISO/IEC 19774:2006), also known as H-anim, it's chosen
for X3D defining interchangeable human figures.
Key Feature:
One frame capture
Two Kinect capture front view and back view.
Capture a view on one frame and then capture another view on next frame
for avoid infrared interference between two kinect.
Snap only need one/two frame, then you can leave and wait. Not like Kinect Fusion
need more frame. or other apps need you not move more than three second
We hope the time for production 3D model is less than 15 second. We are
doing optimization.
Low polygon mesh
Low polygon for real-time 3D application.
Use PCL to stitch front and back point cloud
Use PCL to cap the hole on model
Skeletal and skin
Set skin vertex weight for skeletal automatically
Skin weight by body measurement
Texture
High resolution texture from RGB sensor.
High resolution normal texture if need more visualization details.
Motion animation
Skeletal animation conform to H-anim standard
Support facial expression animation
All matrix transform from view coordinate system to world coordinate system ,
XZ-plane is ground, Y is up. Ready to using in other 3d environment .
Control avatar from captured motion data. Support motion mixer in script
X3D and HTML5
H-anim and X3D with is a Xml-ized format from VRML format, most 3D software
support VRML or X3D. X3D is very easy to parse and integration.
X3D support single skin mesh , skeletal animation, facial expression.
WebGL supported browser can view X3D without any plug-in , 3d avatar and
animation are written in html file in the <X3D></X3D> tags. Test static mesh IE
11, Chrome and Firefox, animation script in devolvement.
X3D browser plug-in can make better 3D game or VR application, faster
and more function.
3ds Max
Import to 3ds Max biped object of Character Studio with skin modifier.
Import skeletal animation to biped animation of Character Studio for edit.
Export 3ds max biped Object with skin and animation support.
Export motion of Character Studio in XML-ized data.
Kinect for window v2, we need two or more
Original Kinect is the bottleneck now, depth resolution and texture resolution is not good for capture
whole human body.
New Kinect One (Kinect for windows v2) have many improvement, like:
