11-16-2016 11:28 PM
I am using htc vive device for google tilt brush application. I am trying to do mixed reality using green matt. Anybody know how i can achive mixed reality video effect. Is their any step by step guidance to make this done. Please help me for this.
11-17-2016 02:24 AM
11-17-2016 02:28 AM
11-17-2016 02:45 AM
07-18-2017 10:51 AM
A bit late replying but I'm working through this at the moment as we have a tiltbrush artist who wants to use our green screen studio. This is where I've got to with my desk research... not easy but is doable if you have the right camera with a zoom...
Tiltbrush doesn't support the 4 way third controller output, but does have the static spectator camera output. Unfortunately the FOV is fixed at 80 degrees.
I'm lucky as I have an Pansaonic GH4 camera - with a 12-35mm lens, which at the wide end is 84 degrees, FOV. In theory zooming in a little should match the camera and spectator camera FOV and then its a case of making sure the camera is on a sturdy tripod and lining up the green screen and spectator camera correctly. You can do this by picking up the spectator camera using the Vive controller side grip buttons, flip up your headset and place the Vive circle on the front of the real cameral lens. You need to experiment to see exactly how the Vive controller relates to the spectator camera position, and may need to nudge the tripod a little. If it all works, I'll post some footage next time I'm in.
That the theory... but I was running some tests yesterday and I'd swear the FOV in Tiltbrush was higher than the GH4 at 12mm. I'll be experimenting with the video resolution and camera settings as it may be I'm losing the edges of the FOV when for example - enabling the in camera image stabilisation rather than optical lens based... neither of which is needed on a tripod but we usually shoot hand held!
We use a Elgato HD60S capture card on the GH4 and feed that into another PC, along with the output from the VR PC running Tiltbrush using OBS and Newtec NDI plugin to send across the network - saving having another capture card. But you can do it all on a single PC with decent specs. Our i7 6700k + 1080 manages it. We're looking to move to a black magic capture system as the Elgato is a bit laggy on our hand held MR videos - so you get mismatch in real / virtual hands when panning etc.
04-06-2018 10:59 AM - edited 04-06-2018 11:01 AM
@cjspringer - Mixed reality with external hardware is still an adventure. Lately, I've been really liking the Liv client combined with OBS and a Go Pro for quick shoots - it has allowed for faster experimentation and works well with Tilt Brush.
Technical Specialist - San Francisco, CA; Monday-Friday
09-21-2018 11:22 AM
You don't need a third controller nor additional tracker. Insude tiltbrush there is a option to position a stationary (or moving) virtual camera. Now all you have to do is to position virtual camera with physical and aligne them. Also it wolud be good for you using greenecreen so You can crop yourself out and merge virtual and physical camera feed togheter.