CORTEXA
← Browse
arxivcs.CVcs.GR2026-07-23

Scene Parameter Saliency via Differentiable Light Transport

Linas Beresna, Eugene Fiume

Gradient-based saliency methods reveal which input features most influence a neural network's output, and are a standard tool for model interpretability. We observe that differentiable renderers, which are conventionally used for parameter optimisation, produce an analogous form of saliency: given any scalar metric evaluated on a rendered image, a single reverse-mode differentiation pass yields per-parameter gradients that identify which scene elements most influence the metric. We call these gradient fields metric saliency maps. Unlike neural saliency, which propagates attribution through learned weights, metric saliency propagates through the image formation process itself, including multi-bounce light transport, capturing parameter dependencies that are semi-opaque to manual inspection. We compute metric saliency maps for qualitatively different objectives: psychovisual glare indices, mean scene luminance, and neural perceptual scores. The saliency rankings differ substantially across metrics for the same scene, with parameters that dominate one objective being negligible for another. The saliency map is specific to the metric, not an intrinsic property of the scene. Our results suggest that differentiable renderers produce derivative images that are as informative for scene understanding as the primal images they were designed to generate.

View free PDFSource page

Related papers

arxivcs.GRcs.CV2026-07-06

StructuredEdit: Constraint-Aware Graphic Design Editing via Differentiable Parameter Propagation

Veeramanohar Avudaiappan, Ritwik Murali

Graphic design editing requires precise manipulation of typography, layout, and visual hierarchy under strict design constraints. Following the introduction of large language models, organizations have increasingly promoted vision-language models to enhance productivity. However,…

View free PDFSource page
arxivcs.CVcs.GR2026-06-26

Meshtryoshka: Differentiable Rendering of Real-World Scenes via Mesh Rasterization

David Charatan, Daniel Xu, Richard Szeliski, George Kopanas, Vincent Sitzmann

Differentiable rendering has emerged as a powerful approach for 3D reconstruction and novel view synthesis. State-of-the-art differentiable rendering methods combine a variety of custom representations of 3D geometry and appearance with specialized renderers. However, most downst…

View free PDFSource page
arxivcs.GRcs.CV2026-07-05

SceneFrom3D: Geometry-Conditioned Outdoor 3D Scene Generation via View Scheduling with Object-Level Control

Geonung Kim, Jeongeun Park, Nuri Ryu, Di Liu, Sunghyun Cho

Geometry-conditioned 3D scene generation enables the creation of 3D environments from user-provided geometry, offering direct control over scene structure and object layout. To generate such 3D scenes, current methods commonly adopt a three-stage design that first defines a view…

View free PDFSource page
arxivcs.CVcs.GR2026-06-26

AEGIR: Modeling Area Emitters for Indoor Inverse Rendering using Gaussian Splatting

Mohamed Shawky Sabae, Philipp Langsteiner, Jan-Niklas Dihlmann, Hendrik Lensch

Inverse rendering requires separating illumination from surface materials, which is highly ambiguous due to their tight coupling in observed images. While Gaussian Splatting is efficient for novel view synthesis, existing relightable methods approximate scene lighting using discr…

View free PDFSource page
arxivcs.CVcs.GR2026-07-09

LightCrafter: PBR-Conditioned Video Diffusion Refinement for Controllable and Consistent Relighting

Zixin Guo, Yehonathan Litman, Yifeng He, John Miller, Chuhan Chen, Deva Ramanan

Video relighting requires balancing long-form temporal consistency with a physically grounded understanding of light transport, which depends on accurate estimation of intrinsic scene properties such as materials, geometry, and illumination. Existing methods follow two paradigms:…

View free PDFSource page
arxivcs.GRcs.CVcs.LG2026-06-29

RenderFormer++: Scalable and Physically Grounded Feed-Forward Neural Rendering

Huangsheng Du, Haoran Zhu, Youcheng Cai, Jinyang Meng, Ligang Liu

We present RenderFormer++, a scalable and physically grounded feed-forward neural rendering framework for global illumination in mesh scenes. Existing Transformer-based neural rendering methods such as RenderFormer achieve promising cross-scene generalization, but suffer from lim…

View free PDFSource page