3d reconstruction

PabloLIborra
Contributor

3d reconstruction

Hello, I am in a new project of mixed reality, and I am trying to do a 3D reconstruction of the environment with the front cameras of the Vive pro.
I'm with the SDKs, and testing with the C ++ API, which according to the documentation, can do what I'm looking for, which is to reconstruct what's in the cameras, in a 3d object on the computer. Testing with this API, always has given me some error and can not do anything at all, then my question is if you have any recommendation of what to do, as it is quite urgent.

 

Thank you very much to all

liyi_zheng
Pioneer

Re: 3d reconstruction

Hi PabloLiborra,

 

does your prebuilt exe like Vive-SRWorks-0.7.5.0\Unity\Experience\Build\Vive SRWorks Demo.exe work normally?

if yes, after pressing 'q' and 'w' in C\sample-vs2015 sample project, it should show the wireframe of  reconstructed objects.

PabloLIborra
Contributor

Re: 3d reconstruction

Hi, thanks for your response.
I tried to do what you tell me, but when i start the demo.exe, everything appears in black, only the controls and the space box defined for the cameras are displayed. I have tried all the options that appear in the command once started, calibrate, start reconstruction ... but none works, besides several of them appear as disabled.

 

The reconstruction.log record:

 

[Reconstruction Engine] [2018-10-24 10:17:21] [LOG] Set DataSource:0
[Reconstruction Engine] [2018-10-24 10:17:21] [LOG] Set not to use sensor device
[Reconstruction Engine] [2018-10-24 10:18:22] [LOG] ViveStaticReconstruction Destruction

[Reconstruction Engine] [2018-10-24 10:19:23] [LOG] Set DataSource:0
[Reconstruction Engine] [2018-10-24 10:19:23] [LOG] Set not to use sensor device
[Reconstruction Engine] [2018-10-24 10:20:48] [LOG] CMD: Start Process
[Reconstruction Engine] [2018-10-24 10:20:55] [LOG] CMD: Stop Process
[Reconstruction Engine] [2018-10-24 10:21:01] [LOG] CMD: Start Process
[Reconstruction Engine] [2018-10-24 10:21:16] [LOG] CMD: Export to Recons3DAsset/Model
[Reconstruction Engine] [2018-10-24 10:23:01] [LOG] ViveStaticReconstruction Destruction

[Reconstruction Engine] [2018-10-24 10:23:47] [LOG] Set DataSource:0
[Reconstruction Engine] [2018-10-24 10:23:47] [LOG] Set not to use sensor device
[Reconstruction Engine] [2018-10-24 10:26:17] [LOG] ViveStaticReconstruction Destruction

[Reconstruction Engine] [2018-10-24 10:26:39] [LOG] Set DataSource:0
[Reconstruction Engine] [2018-10-24 10:26:39] [LOG] Set not to use sensor device
[Reconstruction Engine] [2018-10-24 10:26:58] [LOG] ViveStaticReconstruction Destruction

[Reconstruction Engine] [2018-10-24 10:27:15] [LOG] Set DataSource:0
[Reconstruction Engine] [2018-10-24 10:27:15] [LOG] Set not to use sensor device
[Reconstruction Engine] [2018-10-24 10:27:20] [LOG] ViveStaticReconstruction Destruction

[Reconstruction Engine] [2018-10-24 10:27:25] [LOG] Set DataSource:0
[Reconstruction Engine] [2018-10-24 10:27:25] [LOG] Set not to use sensor device
[Reconstruction Engine] [2018-10-24 10:28:18] [LOG] CMD: Start Process
[Reconstruction Engine] [2018-10-24 10:28:22] [LOG] CMD: Export to Recons3DAsset/Model
[Reconstruction Engine] [2018-10-24 10:28:26] [LOG] CMD: Export to Recons3DAsset/Model
[Reconstruction Engine] [2018-10-24 10:29:17] [LOG] ViveStaticReconstruction Destruction

[Reconstruction Engine] [2018-10-24 10:30:25] [LOG] Set DataSource:0
[Reconstruction Engine] [2018-10-24 10:30:25] [LOG] Set not to use sensor device
[Reconstruction Engine] [2018-10-24 10:34:29] [LOG] CMD: Start Process
[Reconstruction Engine] [2018-10-24 10:34:34] [LOG] CMD: Stop Process
[Reconstruction Engine] [2018-10-24 10:37:46] [LOG] ViveStaticReconstruction Destruction

 

 

liyi_zheng
Pioneer

Re: 3d reconstruction

PabloLIborra
Contributor

Re: 3d reconstruction

Hello,
I have tried all the proposed solutions in the two threads, both to deactivate the other screen, and to redo the config.json, in addition to changing the name of the folder from "Steam" to "steam". It has not worked at all, it still looks black.

 

Also I have everything updated and all well configured supposedly.

 

I add the SRWork.log:

 

[Vive SRWorks] [2018-10-24 13:09:53] [LOG] ViveSR_Initial() success
[Vive SRWorks] [2018-10-24 13:09:53] [LOG] SRWorks Version 0.7.5.0
[Vive SRWorks] [2018-10-24 13:09:53] [LOG] CPU : Windows 8+
[Vive SRWorks] [2018-10-24 13:09:53] [LOG] CPU GetMemory Total : 8147.000000
[Vive SRWorks] [2018-10-24 13:09:53] [LOG] CPU GetMemory InUse : 5875.000000
[Vive SRWorks] [2018-10-24 13:09:54] [LOG] GPU : TITAN Xp
[Vive SRWorks] [2018-10-24 13:09:54] [LOG] GPU driver : 41634
[Vive SRWorks] [2018-10-24 13:09:54] [LOG] GPU memory usage : 4726.261719
[Vive SRWorks] [2018-10-24 13:09:54] [LOG] GPU memory loading: 11
[Vive SRWorks] [2018-10-24 13:09:54] [LOG] ViveSR_CreateModule() start
[JSON] [2018-10-24 13:09:54] [LOG] found steam install path
[JSON] [2018-10-24 13:09:54] [LOG] using device : LHR-7733A245
[JSON] [2018-10-24 13:09:54] [LOG] using system : lighthouse
[JSON] [2018-10-24 13:09:55] [LOG] found device config file : D:/Program Files (x86)/steam/config\lighthouse\LHR-7733A245\config.json
[JSON] [2018-10-24 13:09:55] [LOG] Cali_V2D_00000
[JSON] [2018-10-24 13:09:55] [LOG] MIE_GCP_00000
[JSON] [2018-10-24 13:09:55] [LOG] found steam install path
[JSON] [2018-10-24 13:09:55] [LOG] using device : LHR-7733A245
[JSON] [2018-10-24 13:09:55] [LOG] using system : lighthouse
[JSON] [2018-10-24 13:09:56] [LOG] found device config file : D:/Program Files (x86)/steam/config\lighthouse\LHR-7733A245\config.json
[JSON] [2018-10-24 13:09:56] [LOG] Cali_V2D_00000
[JSON] [2018-10-24 13:09:56] [LOG] MIE_GCP_00000
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] SeeThroughModuleSetDevice:: D3DDevice
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] CM_MT1_MID0_00000
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] ViveSR_CreateModule() end
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] ViveSR_CreateModule() start
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] CM_MT4_MID2_00000
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] ViveSR_CreateModule() end
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] ViveSR_CreateModule() start
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] ReconsModuleSetDevice:: D3DDevice
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] CM_MT5_MID4_00000
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] ViveSR_CreateModule() end
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] SM0ViveSR_StartModule() start
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] SM0ViveSR_StartModule() check pass
[DEVICE_VIVE_HMD_DUALCAM_0_DLL] [2018-10-24 13:09:56] [LOG] initialization mode 2-2
[DEVICE_VIVE_HMD_DUALCAM_0_DLL] [2018-10-24 13:09:56] [LOG] Create Mapping table start
[DEVICE_VIVE_HMD_DUALCAM_0_DLL] [2018-10-24 13:09:56] [LOG] Create Mapping table end
[DEVICE_VIVE_HMD_DUALCAM_0_DLL] [2018-10-24 13:09:56] [LOG] Create Mapping table start
[DEVICE_VIVE_HMD_DUALCAM_0_DLL] [2018-10-24 13:09:56] [LOG] Create Mapping table end
[DEVICE_VIVE_HMD_DUALCAM_0_DLL] [2018-10-24 13:09:56] [LOG] initialization mode end2-2
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] SM0ViveSR_StartModule() initial end
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] SM0ViveSR_StartModule() initial pass
[DEVICE_VIVE_HMD_DUALCAM_0] [2018-10-24 13:09:56] [-!-ERROR-!-] [CODE: 0x9C42] M_MSCD_AcViStSrv_40002 @SeeThroughModule::start:140
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] SM0ViveSR_StartModule() start pass
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] SM0_00000
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] SM0ViveSR_StartModule() end
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] SM2ViveSR_StartModule() start
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] SM2ViveSR_StartModule() check pass
[ENGINE_DEPTH_2] [2018-10-24 13:09:56] [LOG] init_S
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] SM2ViveSR_StartModule() initial end
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] SM2ViveSR_StartModule() initial pass
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] SM2ViveSR_StartModule() start pass
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] SM2_00000
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] SM2ViveSR_StartModule() end
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] SM4ViveSR_StartModule() start
[Vive SRWorks] [2018-10-24 13:09:56] [LOG] SM4ViveSR_StartModule() check pass
[Vive SRWorks] [2018-10-24 13:09:57] [LOG] SM4ViveSR_StartModule() initial end
[Vive SRWorks] [2018-10-24 13:09:57] [LOG] SM4ViveSR_StartModule() initial pass
[Vive SRWorks] [2018-10-24 13:09:57] [LOG] SM4ViveSR_StartModule() start pass
[Vive SRWorks] [2018-10-24 13:09:57] [LOG] SM4_00000
[Vive SRWorks] [2018-10-24 13:09:57] [LOG] SM4ViveSR_StartModule() end
[Vive SRWorks] [2018-10-24 13:09:57] [LOG] ViveSR_ModuleLink() start
[Vive SRWorks] [2018-10-24 13:09:57] [LOG] LM2-4_MODE1_00000
[Vive SRWorks] [2018-10-24 13:09:57] [LOG] ViveSR_ModuleLink() end
[Vive SRWorks] [2018-10-24 13:10:12] [LOG] CLM_M0_M2_mode1
[Vive SRWorks] [2018-10-24 13:10:13] [LOG] CLM_M0_M2_mode-1
[Vive SRWorks] [2018-10-24 13:10:28] [LOG] ViveSR_Stop() start
[Vive SRWorks] [2018-10-24 13:10:28] [LOG] ViveSR_Stop() phase1
[Vive SRWorks] [2018-10-24 13:10:28] [LOG] ViveSR_Stop() phase2
[Vive SRWorks] [2018-10-24 13:10:28] [LOG] ViveSR_Stop() phase2-0
[DEVICE_VIVE_HMD_DUALCAM_0_DLL] [2018-10-24 13:10:28] [LOG] TurnOff
[DEVICE_VIVE_HMD_DUALCAM_0_DLL] [2018-10-24 13:10:28] [LOG] TurnOff end
[DEVICE_VIVE_HMD_DUALCAM_0_DLL] [2018-10-24 13:10:28] [LOG] ~Undistortion table
[DEVICE_VIVE_HMD_DUALCAM_0_DLL] [2018-10-24 13:10:28] [LOG] ~Undistortion table
[Vive SRWorks] [2018-10-24 13:10:28] [LOG] ViveSR_Stop() phase2-0_end
[Vive SRWorks] [2018-10-24 13:10:28] [LOG] ViveSR_Stop() phase2-1
[Vive SRWorks] [2018-10-24 13:10:28] [LOG] ViveSR_Stop() phase2-1_end
[Vive SRWorks] [2018-10-24 13:10:28] [LOG] ViveSR_Stop() phase2-2
[ENGINE_DEPTH_2] [2018-10-24 13:10:28] [LOG] release_S
[Vive SRWorks] [2018-10-24 13:10:28] [LOG] ViveSR_Stop() phase2-2_end
[Vive SRWorks] [2018-10-24 13:10:28] [LOG] ViveSR_Stop() phase2-3
[Vive SRWorks] [2018-10-24 13:10:28] [LOG] ViveSR_Stop() phase2-3_end
[Vive SRWorks] [2018-10-24 13:10:28] [LOG] ViveSR_Stop() phase2-4
[Vive SRWorks] [2018-10-24 13:10:28] [LOG] ViveSR_Stop() phase2-4_end
[Vive SRWorks] [2018-10-24 13:10:28] [LOG] ViveSR_Stop() phase2-5
[Vive SRWorks] [2018-10-24 13:10:28] [LOG] ViveSR_Stop() phase2-5_end
[Vive SRWorks] [2018-10-24 13:10:28] [LOG] ViveSR_Stop() phase3
[Vive SRWorks] [2018-10-24 13:10:28] [LOG] STP_WORKs__00000
[Vive SRWorks] [2018-10-24 13:10:28] [LOG] ViveSR_Stop() end
[Vive SRWorks] [2018-10-24 13:10:28] [LOG] UnitySetGraphicsDevice:: D3D11

 

DanY
Pioneer

Re: 3d reconstruction

have you enabled camera in SteamVR setting?

check this https://developer.vive.com/resources/knowledgebase/vive-pro-srworks-sdk-qa/

Labels