Restoration of the optical properties of the scene by means of differentiable rendering

The authors of this work propose a method for recovering the optical properties of real-world objects with relatively low error. The recovery algorithm is based on the differential rendering method, where each object in the scene has its own optical model, whose parameters are adjusted by an optimizer that compares the original image with the synthesized image on a per-pixel basis, finds the error, and modifies the parameters accordingly to bring the initial model closer to reality. To optimize the calculations, the authors suggest selecting a limited number of the most significant points from different camera viewpoints, and then only analyzing these data points during calculations, which reduces the computation time without sacrificing accuracy.