06-11-2019 05:32 PM
With the SDK patch 0.8.0p1, now is possible to use Hand Tracking SDK + SRWorks in See Through mode. However, when I configure both SDKs together as in this unity example, I got different position for 3D hand and my real hand as in image bellow.
This project was built on ViveSR/Sample/Sample scene.
This problem occurs ins both hand in both eyes. @zzy how can I find the translation matrix that fixes this position?
I intend to use handmat material, that made virtual hand invisible, to interact with virtual objects. As I finished the integration with Leap Motion Interaction Engine, I will be able to use all interactive features of Leap SDK. I will share the interaction code soon as I fix some small details.
06-11-2019 07:36 PM
I would recommend you to try with SDK v0.8.1 to see if this problem still exists. Prior to v0.8.1, we used hand calibrated intrinsics for Vive Pro, this might be different from the parameters used in SRWorks. In v0.8.1, we changed to use OpenVR API to get intrinsics which should be similar to what SRWorks used.
As for the hand material, if you don't need the hand, you can simply disable the HandRenderer, or change it's layer to an invisible layer.
06-12-2019 06:15 PM
Thanks for the fast reply. I tried your suggestion, but as the image below I still have 3D hand misplaced with my real hand in Hand Tracking SDK 0.8.1. So, how can I found the translation matrix that aligns these hands?
Here is my unity example scene where the dependencies are SRWorks SDK 0.8.0.2 and Hand Track SDK 0.8.1.
In this new SDK version, the hand detection is much better! Thanks for the hard work.
06-12-2019 07:52 PM
Actually, we don't have the translation matrix. In Hand Tracking SDK, we calculate 3d points based on front camera intrinsics and extriniscs. The unity plugin renders the 3d points based on rendering camera settings, and thus displayed on your screen and HMD.
I think you may ask the SRWorks side for this, if they have some mappings for virtual objects that need to appear at some specific place on the texture.
@DanY Can you help on this question? Thank you.
3 weeks ago
I read all the topics in SRWorks sections, but I didn't get any clue about how to solve this transformation problem. I also test SRHands example, but i had the same problem(left displacement) with depth images.
Another related problem is the position of depth image in SRWorks samples in my device looks that it's in the same position of hand object. In SRWorks provided sample scene only the right eye can see the depth map occlusion, and the virtual camera was set on the left eye, so we can't see the depth occlusion by default in unity game windows. After making the proper adjustments, I get the same problem that depth mask is left displaced as when I saw in the right eye trough the headset, as virtual objects.
I will post a photo of this problem. I belive that these problems are related.
2 weeks ago