Fast sensitivity control method with differentiable optics

Differentiable optics integrates optical design with image processing, enabling joint optimization of optical systems and neural networks through task-specific evaluation metrics. However, controlling lens tolerance sensitivity during optimization remains an unresolved challenge, often resulting in significant performance degradation due to manufacturing and assembly tolerances. In this work, we propose a fast sensitivity control method tailored for different optical models. Our approach addresses sensitivity from three key aspects: tolerance sensitivity, uniformity of tolerance degradation, and symmetry of tolerance boundaries. Using the wavefront-focusing method, we enhance optimization stability by compensating for defocus and focusing the evaluation on the optimal image plane. Additionally, the optical path differential method eliminates the need for repeated ray tracing of perturbed systems, significantly reducing computational costs. Experimental results with two advanced smartphone lenses, a wide-angle and a telephoto lens, validate the effectiveness of our method. This work provides a practical solution for desensitization optimization in differentiable optics, offering new possibilities for optical desensitization and joint design in computational imaging tasks.