Error Inside optixRenderer.render

[iahmedmaher]

Hello,

When running the testRealBRDFLight.py script on Example 1, I get the following error message:

"double free or corruption (!prev)"

If I set MALLOC_CHECK_ to 2, it becomes

"free(): invalid pointer"

This error message occurs during the execution of this line of code .

I am using Nvidia Optix version 6.0 on Ubuntu, and I installed the pybind11 package inside this repo instead of the one on PyPI. I tried using python 3.9 and python 3.7 but both created the same error.

I tried debugging using gdb and valgrind, but I am unable to get any useful message so far.

I am not sure what can be done here, so I would appreciate any help.

[KoykL]

you can try compiling OptixRendererShadow in debug mode. that works for me.

[huynhtruc0309]

Dear @KoykL can you guide me on how to compile OptixRendererShadow in debug mode? I am using vscode. I ran
CUDA_VISIBLE_DEVICES=0 python testRealRender.py --isOptimize --testList testList.txt --isVisLampMesh in vscode terminal and stuck there.