Research

2026

1. ECCV

   CAR-MIL: Counterfactual Attention Regularization for Multiple Instance Learning

   Imane Chraki, Pierre Marza, Stergios Christodoulidis, Maria Vakalopoulou

   European Conference on Computer Vision (ECCV) 2026
2. MICCAI (Early Accept)

   From Patches to Patients: A study of the tile-to-slide performance transferability in Digital Pathology

   Sofiène Boutaj, Leo Fillioux, Maria Vakalopoulou, Stergios Christodoulidis, Pierre Marza

   Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2026

   Abs Bib PDF

   Foundation Models (FMs) have recently redefined the state-of-the-art in histopathology by providing robust representations for whole-slide image (WSI) analysis. However, selecting the optimal foundation model (FM) for a specific clinical cohort currently requires multiple preprocessing steps, followed by computationally expensive feature extraction and the training of a Multiple Instance Learning (MIL) aggregator for every model. In this work, we investigate whether efficient tile-level linear probing can serve as a reliable proxy for slide-level performance, reducing the need to run full slide-level pipelines for every candidate encoder. We benchmark 19 state-of-the-art FMs on 42 slide-level and 16 tile-level tasks, comparing tile probing metrics against slide-level outcomes using ABMIL and Mean Pooling aggregations. We observe a high correlation between tile and slide performance across varying task difficulties, indicating that encoder representation quality is the primary determinant of WSI success. Sensitivity analyses show that transferability is stable across models and is more influenced by cohort sizes and numbers of tiles per slide than by average task difficulty. We also measure the agreement in best performing models between tile and slide-level tasks, showing tile benchmarks reliably shortlist strong candidates. Overall, our study indicates that tile-level benchmarking provides an efficient and practical first step for narrowing down candidate models, while slide-level evaluation remains essential for final validation on clinical tasks.

   @article{boutaj2026patches,
     bibtex_show = {true},
     abbr = {MICCAI (Early Accept)},
     title = {From Patches to Patients: A study of the tile-to-slide performance transferability in Digital Pathology},
     author = {Boutaj, Sofi{\`e}ne and Fillioux, Leo and Vakalopoulou, Maria and Christodoulidis, Stergios and Marza, Pierre},
     journal = {Medical Image Computing and Computer-Assisted Intervention (MICCAI)},
     year = {2026},
     pdf = {https://arxiv.org/abs/2606.10778},
     selected = {true}
   }

3. MICCAI

   Pathologist Attention-Aligned Report Generation for Prostate Histopathology

   Ruoyu Xue, Suryakant Singh, Souradeep Chakraborty, Pierre Marza, Oksana Yaskiv, Friedman Constantin, Natallia Sheuka, Paul Friedman, Bharat Ramlal, Beatrice Knudsen, Rajarsi Gupta, Joel Saltz, Prateek Prasanna, Gregory Zelinsky, Dimitris Samaras

   Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2026
4. MICCAI

   Information Maximization for Long-Tailed Semi-Supervised Domain Generalization

   Leo Fillioux, Omprakash Chakraborty, Quentin Gopée, Pierre Marza, Paul-Henry Cournède, Stergios Christodoulidis, Maria Vakalopoulou, Ismail Ben Ayed, Jose Dolz

   Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2026

   Abs Bib PDF

   Semi-supervised domain generalization (SSDG) has recently emerged as an appealing alternative to tackle domain generalization when labeled data is scarce but unlabeled samples across domains are abundant. In this work, we identify an important limitation that hampers the deployment of state-of-the-art methods on more challenging but practical scenarios. In particular, state-of-the-art SSDG severely suffers in the presence of long-tailed class distributions, an arguably common situation in real-world settings. To alleviate this limitation, we propose IMaX, a simple yet effective objective based on the well-known InfoMax principle adapted to the SSDG scenario, where the Mutual Information (MI) between the learned features and latent labels is maximized, constrained by the supervision from the labeled samples. Our formulation integrates an α-entropic objective, which mitigates the class-balance bias encoded in the standard marginal entropy term of the MI, thereby better handling arbitrary class distributions. IMaX can be seamlessly plugged into recent state-of-the-art SSDG, consistently enhancing their performance, as demonstrated empirically across two different image modalities.

   @article{fillioux2026information,
     bibtex_show = {true},
     abbr = {MICCAI},
     title = {Information Maximization for Long-Tailed Semi-Supervised Domain Generalization},
     author = {Fillioux, Leo and Chakraborty, Omprakash and Gop{\'e}e, Quentin and Marza, Pierre and Courn{\`e}de, Paul-Henry and Christodoulidis, Stergios and Vakalopoulou, Maria and Ayed, Ismail Ben and Dolz, Jose},
     journal = {Medical Image Computing and Computer-Assisted Intervention (MICCAI)},
     year = {2026},
     pdf = {https://arxiv.org/abs/2603.08434}
   }

5. MIDL

   Counterfactual Intervention in Attention Multiple Instance Learning For Digital Pathology

   Imane Chraki, Pierre Marza, Stergios Christodoulidis, Maria Vakalopoulou

   In Medical Imaging with Deep Learning (MIDL) 2026

   Abs Bib PDF

   Attention-based Multiple Instance Learning (MIL) has become a prominent framework for analysing whole-slide images (WSI). These models have been shown to achieve good performance on classification tasks, while also offering an inherent proxy for interpretability through attention weights. In this work, we first question the validity of using attention for the interpretability of MIL models. Subsequently, we propose Counterfactual Intervention in Attention for MIL (CIA-MIL), a causal extension of attention-based MIL that explicitly measures and optimizes the contribution of attention to slide-level predictions. Across four histopathology classification benchmarks (BRCA, NSCLC, LUAD, Camelyon16) and two feature encoders (Resnet50, UNI), we investigate how the interpretability of attention relates to the representation space, and the downstream performance. We then show that CIA-MIL achieves performance comparable to strong MIL baselines while providing a more causally meaningful attention vector for explaining the model’s outcome. Qualitative perturbation experiments show that dropping the top-attended patches leads to a larger confidence degradation in CIA-MIL compared to baseline ABMIL, highlighting the potential of causal supervision for reliable and interpretable WSI-based prediction.

   @inproceedings{chraki2026counterfactual,
     bibtex_show = {true},
     abbr = {MIDL},
     title = {Counterfactual Intervention in Attention Multiple Instance Learning For Digital Pathology},
     author = {Chraki, Imane and Marza, Pierre and Christodoulidis, Stergios and Vakalopoulou, Maria},
     booktitle = {Medical Imaging with Deep Learning (MIDL)},
     year = {2026},
     pdf = {https://openreview.net/pdf?id=s5qMD7LKEI}
   }

6. CVPR Findings

   Ticon: A slide-level tile contextualizer for histopathology representation learning

   Varun Belagali, Saarthak Kapse, Pierre Marza, Srijan Das, Zilinghan Li, Sofiène Boutaj, Pushpak Pati, Srikar Yellapragada, Tarak Nath Nandi, Ravi K Madduri, others

   In Computer Vision and Pattern Recognition (CVPR) Findings 2026

   Abs Bib Project Page PDF Code

   The interpretation of small tiles in large whole slide images (WSI) often needs a larger image context. We introduce TICON, a transformer-based tile representation contextualizer that produces rich, contextualized embeddings for any application in computational pathology. Standard tile encoder-based pipelines, which extract embeddings of tiles stripped from their context, fail to model the rich slide-level information essential for both local and global tasks. Furthermore, different tile-encoders excel at different downstream tasks. Therefore, a unified model is needed to contextualize embeddings derived from any tile-level foundation model. TICON addresses this need with a single, shared encoder, pretrained using a masked modeling objective to simultaneously unify and contextualize representations from diverse tile-level pathology foundation models. Our experiments demonstrate that TICON-contextualized embeddings significantly improve performance across many different tasks, establishing new state-of-the-art results on tile-level benchmarks (i.e., HEST-Bench, THUNDER, CATCH) and slide-level benchmarks (i.e., Patho-Bench). Finally, we pretrain an aggregator on TICON to form a slide-level foundation model, using only 11K WSIs, outperforming SoTA slide-level foundation models pretrained with up to 350K WSIs.

   @inproceedings{belagali2026ticon,
     bibtex_show = {true},
     abbr = {CVPR Findings},
     title = {Ticon: A slide-level tile contextualizer for histopathology representation learning},
     author = {Belagali, Varun and Kapse, Saarthak and Marza, Pierre and Das, Srijan and Li, Zilinghan and Boutaj, Sofi{\`e}ne and Pati, Pushpak and Yellapragada, Srikar and Nandi, Tarak Nath and Madduri, Ravi K and others},
     booktitle = {Computer Vision and Pattern Recognition (CVPR) Findings},
     year = {2026},
     pdf = {https://arxiv.org/abs/2512.21331},
     html = {https://cvlab-stonybrook.github.io/TICON/},
     code = {https://github.com/cvlab-stonybrook/TICON},
     selected = {true}
   }

7. OCTOPUS: Enhancing the Spatial-Awareness of Vision SSMs with Multi-Dimensional Scans and Traversal Selection

   Kunal Mahatha, Ali Bahri, Pierre Marza, Sahar Dastani, Maria Vakalopoulou, Stergios Christodoulidis, Jose Dolz, Christian Desrosiers

   arXiv 2026

   Bib PDF

   @article{mahatha2026octopus,
     bibtex_show = {true},
     title = {OCTOPUS: Enhancing the Spatial-Awareness of Vision SSMs with Multi-Dimensional Scans and Traversal Selection},
     author = {Mahatha, Kunal and Bahri, Ali and Marza, Pierre and Dastani, Sahar and Vakalopoulou, Maria and Christodoulidis, Stergios and Dolz, Jose and Desrosiers, Christian},
     journal = {arXiv},
     year = {2026},
     pdf = {https://arxiv.org/abs/2602.00904}
   }

2025

1. NeurIPS D&B (Spotlight)

   THUNDER: Tile-level Histopathology image UNDERstanding benchmark

   Pierre Marza, Leo Fillioux, Sofiène Boutaj, Kunal Mahatha, Christian Desrosiers, Pablo Piantanida, Jose Dolz, Stergios Christodoulidis, Maria Vakalopoulou

   Neural Information Processing Systems (NeurIPS) D&B Track (Spotlight) 2025

   Abs Bib Project Page PDF Code

   Progress in a research field can be hard to assess, in particular when many concurrent methods are proposed in a short period of time. This is the case in digital pathology, where many foundation models have been released recently to serve as feature extractors for tile-level images, being used in a variety of downstream tasks, both for tile- and slide-level problems. Benchmarking available methods then becomes paramount to get a clearer view of the research landscape. In particular, in critical domains such as healthcare, a benchmark should not only focus on evaluating downstream performance, but also provide insights about the main differences between methods, and importantly, further consider uncertainty and robustness to ensure a reliable usage of proposed models. For these reasons, we introduce THUNDER, a tile-level benchmark for digital pathology foundation models, allowing for efficient comparison of many models on diverse datasets with a series of downstream tasks, studying their feature spaces and assessing the robustness and uncertainty of predictions informed by their embeddings. THUNDER is a fast, easy-to-use, dynamic benchmark that can already support a large variety of state-of-the-art foundation, as well as local user-defined models for direct tile-based comparison. In this paper, we provide a comprehensive comparison of 23 foundation models on 16 different datasets covering diverse tasks, feature analysis, and robustness. The code for THUNDER is publicly available at https://github.com/MICS-Lab/thunder.

   @article{marza2025thunder,
     bibtex_show = {true},
     abbr = {NeurIPS D&B (Spotlight)},
     title = {{THUNDER}: Tile-level Histopathology image UNDERstanding benchmark},
     author = {Marza, Pierre and Fillioux, Leo and Boutaj, Sofi{\`e}ne and Mahatha, Kunal and Desrosiers, Christian and Piantanida, Pablo and Dolz, Jose and Christodoulidis, Stergios and Vakalopoulou, Maria},
     journal = {Neural Information Processing Systems (NeurIPS) D&B Track (Spotlight)},
     year = {2025},
     pdf = {https://arxiv.org/abs/2507.07860},
     html = {https://mics-lab.github.io/thunder/},
     code = {https://github.com/MICS-Lab/thunder},
     selected = {true}
   }

2. ICCV

   Controllable Latent Space Augmentation for Digital Pathology

   Sofiène Boutaj, Marin Scalbert, Pierre Marza, Florent Couzinie-Devy, Maria Vakalopoulou, Stergios Christodoulidis

   In International Conference on Computer Vision (ICCV) 2025

   Abs Bib PDF Code

   Whole slide image (WSI) analysis in digital pathology presents unique challenges due to the gigapixel resolution of WSIs and the scarcity of dense supervision signals. While Multiple Instance Learning (MIL) is a natural fit for slidelevel tasks, training robust models requires large and diverse datasets. Even though image augmentation techniques could be utilized to increase data variability and reduce overfitting, implementing them effectively is not a trivial task. Traditional patch-level augmentation is prohibitively expensive due to the large number of patches extracted from each WSI, and existing feature-level augmentation methods lack control over transformation semantics. We introduce HistAug, a fast and efficient generative model for controllable augmentations in the latent space for digital pathology. By conditioning on explicit patch-level transformations (e.g., hue, erosion), HistAug generates realistic augmented embeddings while preserving initial semantic information. Our method allows the processing of a large number of patches in a single forward pass efficiently, while at the same time consistently improving MIL model performance. Experiments across multiple slide-level tasks and diverse organs show that HistAug outperforms existing methods, particularly in low-data regimes. Ablation studies confirm the benefits of learned transformations over noise-based perturbations and highlight the importance of uniform WSI-wise augmentation. Code is available at https://github.com/MICS-Lab/HistAug.

   @inproceedings{boutaj2025controllable,
     bibtex_show = {true},
     abbr = {ICCV},
     title = {Controllable Latent Space Augmentation for Digital Pathology},
     author = {Boutaj, Sofi{\`e}ne and Scalbert, Marin and Marza, Pierre and Couzinie-Devy, Florent and Vakalopoulou, Maria and Christodoulidis, Stergios},
     booktitle = {International Conference on Computer Vision (ICCV)},
     year = {2025},
     pdf = {https://arxiv.org/abs/2508.14588},
     code = {https://github.com/MICS-Lab/HistAug},
     selected = {true}
   }

3. arXiv

   CDG-MAE: Learning Correspondences from Diffusion Generated Views

   Varun Belagali, Pierre Marza, Srikar Yellapragada, Zilinghan Li, Tarak Nath Nandi, Ravi K Madduri, Joel Saltz, Stergios Christodoulidis, Maria Vakalopoulou, Dimitris Samaras

   arXiv preprint arXiv:2506.18164 2025

   Abs Bib PDF

   Learning dense correspondences, critical for application such as video label propagation, is hindered by tedious and unscalable manual annotation. Self-supervised methods address this by using a cross-view pretext task, often modeled with a masked autoencoder, where a masked target view is reconstructed from an anchor view. However, acquiring effective training data remains a challenge - collecting diverse video datasets is difficult and costly, while simple image crops lack necessary pose variations. This paper introduces CDG-MAE, a novel MAE-based self-supervised method that uses diverse synthetic views generated from static images via an image-conditioned diffusion model. These generated views exhibit substantial changes in pose and perspective, providing a rich training signal that overcomes the limitations of video and crop-based anchors. We present a quantitative method to evaluate local and global consistency of generated images, discussing their use for cross-view self-supervised pretraining. Furthermore, we enhance the standard single-anchor MAE setting to a multi-anchor strategy to effectively modulate the difficulty of pretext task. CDG-MAE significantly outperforms state-of-the-art MAE methods reliant only on images and substantially narrows the performance gap to video-based approaches.

   @article{belagali2025cdg,
     bibtex_show = {true},
     abbr = {arXiv},
     title = {CDG-MAE: Learning Correspondences from Diffusion Generated Views},
     author = {Belagali, Varun and Marza, Pierre and Yellapragada, Srikar and Li, Zilinghan and Nandi, Tarak Nath and Madduri, Ravi K and Saltz, Joel and Christodoulidis, Stergios and Vakalopoulou, Maria and Samaras, Dimitris},
     journal = {arXiv preprint arXiv:2506.18164},
     year = {2025},
     pdf = {https://arxiv.org/abs/2506.18164}
   }

2024

1. PhD thesis

   Learning spatial representations for single-task navigation and multi-task policies

   Pierre Marza

   2024

   Abs Bib PDF

   Autonomously behaving in the 3D world requires a large set of skills, among which are perceiving the surrounding environment, representing it precisely and efficiently enough to keep track of the past, making decisions and acting to achieve specified goals. Animals, for instance humans, stand out by their robustness when it comes to acting in the world. In particular, they can efficiently generalize to new environments, but are also able to rapidly master many tasks of interest from a few examples. This manuscript will study how artificial neural networks can be trained to acquire a subset of these abilities. We will first focus on training neural agents to perform semantic mapping, both from augmented supervision signal and with proposed neural-based scene representations. Neural agents are often trained with Reinforcement Learning (RL) from a sparse reward signal. Guiding the learning of scene mapping abilities by augmenting the vanilla RL supervision signal with auxiliary spatial reasoning tasks will help navigating efficiently. Instead of modifying the training signal of neural agents, we will also see how incorporating specific neural-based representations of semantics and geometry within the architecture of the agent can help improve performance in goal-driven navigation. Then, we will study how to best explore a 3D environment in order to build neural representations of space that are as satisfying as possible based on robotic-oriented metrics we will propose. Finally, we will move from navigation-only to multi-task agents, and see how important it is to tailor visual features from sensor observations to the task at hand to perform a wide variety of tasks, but also to adapt to new unknown tasks from a few demonstrations. This manuscript will thus address different important questions such as: How to represent a 3D scene and keep track of previous experience in an environment? – How to robustly adapt to new environments, scenarios, and potentially new tasks? – How to train agents on long-horizon sequential tasks? – How to jointly master all required sub-skills? – What is the importance of perception in robotics?

   @phdthesis{marza2024learning,
     bibtex_show = {true},
     abbr = {PhD thesis},
     title = {Learning spatial representations for single-task navigation and multi-task policies},
     author = {Marza, Pierre},
     school = {INSA Lyon},
     year = {2024},
     month = nov,
     pdf = {https://theses.hal.science/tel-04846767/},
     selected = {true}
   }

2. CVPR

   Task-conditioned adaptation of visual features in multi-task policy learning

   Pierre Marza, Laetitia Matignon, Olivier Simonin, Christian Wolf

   Computer Vision and Pattern Recognition (CVPR) 2024

   Abs Bib Project Page PDF Code

   Successfully addressing a wide variety of tasks is a core ability of autonomous agents, which requires flexibly adapting the underlying decision-making strategies and, as we argue in this work, also adapting the underlying perception modules. An analogical argument would be the human visual system, which uses top-down signals to focus attention determined by the current task. Similarly, in this work, we adapt pre-trained large vision models conditioned on specific downstream tasks in the context of multi-task policy learning. We introduce task-conditioned adapters that do not require finetuning any pre-trained weights, combined with a single policy trained with behavior cloning and capable of addressing multiple tasks. We condition the policy and visual adapters on task embeddings, which can be selected at inference if the task is known, or alternatively inferred from a set of example demonstrations. To this end, we propose a new optimization-based estimator. We evaluate the method on a wide variety of tasks of the CortexBench benchmark and show that, compared to existing work, it can be addressed with a single policy. In particular, we demonstrate that adapting visual features is a key design choice and that the method generalizes to unseen tasks given visual demonstrations.

   @article{marza2024task,
     bibtex_show = {true},
     abbr = {CVPR},
     title = {Task-conditioned adaptation of visual features in multi-task policy learning},
     author = {Marza, Pierre and Matignon, Laetitia and Simonin, Olivier and Wolf, Christian},
     journal = {Computer Vision and Pattern Recognition (CVPR)},
     year = {2024},
     pdf = {https://arxiv.org/abs/2402.07739},
     html = {https://pierremarza.github.io/projects/task_conditioned_adaptation/},
     code = {https://github.com/PierreMarza/task_conditioned_adaptation},
     selected = {true}
   }

3. IROS

   AutoNeRF: Training Implicit Scene Representations with Autonomous Agents

   Pierre Marza, Laetitia Matignon, Olivier Simonin, Dhruv Batra, Christian Wolf, Devendra Singh Chaplot

   International Conference on Intelligent Robots and Systems (IROS) 2024

   Abs Bib Project Page PDF Code

   Implicit representations such as Neural Radiance Fields (NeRF) have been shown to be very effective at novel view synthesis. However, these models typically require manual and careful human data collection for training. In this paper, we present AutoNeRF, a method to collect data required to train NeRFs using autonomous embodied agents. Our method allows an agent to explore an unseen environment efficiently and use the experience to build an implicit map representation autonomously. We compare the impact of different exploration strategies including handcrafted frontier-based exploration and modular approaches composed of trained high-level planners and classical low-level path followers. We train these models with different reward functions tailored to this problem and evaluate the quality of the learned representations on four different downstream tasks: classical viewpoint rendering, map reconstruction, planning, and pose refinement. Empirical results show that NeRFs can be trained on actively collected data using just a single episode of experience in an unseen environment, and can be used for several downstream robotic tasks, and that modular trained exploration models significantly outperform the classical baselines.

   @article{marza2023autonerf,
     bibtex_show = {true},
     abbr = {IROS},
     title = {AutoNeRF: Training Implicit Scene Representations with Autonomous Agents},
     author = {Marza, Pierre and Matignon, Laetitia and Simonin, Olivier and Batra, Dhruv and Wolf, Christian and Chaplot, Devendra Singh},
     journal = {International Conference on Intelligent Robots and Systems (IROS)},
     year = {2024},
     pdf = {https://arxiv.org/abs/2304.11241},
     html = {https://pierremarza.github.io/projects/autonerf/},
     code = {https://github.com/PierreMarza/autonerf}
   }

2023

1. ICCV

   Multi-Object Navigation with dynamically learned neural implicit representations

   Pierre Marza, Laetitia Matignon, Olivier Simonin, Christian Wolf

   International Conference on Computer Vision (ICCV) 2023

   Abs Bib Project Page PDF Code

   Understanding and mapping a new environment are core abilities of any autonomously navigating agent. While classical robotics usually estimates maps in a stand-alone manner with SLAM variants, which maintain a topological or metric representation, end-to-end learning of navigation keeps some form of memory in a neural network. Networks are typically imbued with inductive biases, which can range from vectorial representations to birds-eye metric tensors or topological structures. In this work, we propose to structure neural networks with two neural implicit representations, which are learned dynamically during each episode and map the content of the scene: (i) the Semantic Finder predicts the position of a previously seen queried object; (ii) the Occupancy and Exploration Implicit Representation encapsulates information about explored area and obstacles, and is queried with a novel global read mechanism which directly maps from function space to a usable embedding space. Both representations are leveraged by an agent trained with Reinforcement Learning (RL) and learned online during each episode. We evaluate the agent on Multi-Object Navigation and show the high impact of using neural implicit representations as a memory source.

   @article{marza2023dynamic_impl_repr,
     bibtex_show = {true},
     abbr = {ICCV},
     title = {Multi-Object Navigation with dynamically learned neural implicit representations},
     author = {Marza, Pierre and Matignon, Laetitia and Simonin, Olivier and Wolf, Christian},
     journal = {International Conference on Computer Vision (ICCV)},
     year = {2023},
     html = {https://pierremarza.github.io/projects/dynamic_implicit_representations/},
     pdf = {https://arxiv.org/abs/2210.05129},
     code = {https://github.com/PierreMarza/dynamic_implicit_representations}
   }

2022

1. IROS

   Teaching Agents how to Map: Spatial Reasoning for Multi-Object Navigation (Winning entry of the MultiON Challenge at CVPR 2021)

   Pierre Marza, Laëtitia Matignon, Olivier Simonin, Christian Wolf

   International Conference on Intelligent Robots and Systems (IROS) 2022

   Abs Bib Project Page PDF Code

   In the context of visual navigation, the capacity to map a novel environment is necessary for an agent to exploit its observation history in the considered place and efficiently reach known goals. This ability can be associated with spatial reasoning, where an agent is able to perceive spatial relationships and regularities, and discover object affordances. In classical Reinforcement Learning (RL) setups, this capacity is learned from reward alone. We introduce supplementary supervision in the form of auxiliary tasks designed to favor the emergence of spatial perception capabilities in agents trained for a goal-reaching downstream objective. We show that learning to estimate metrics quantifying the spatial relationships between an agent at a given location and a goal to reach has a high positive impact in Multi-Object Navigation settings. Our method significantly improves the performance of different baseline agents, that either build an explicit or implicit representation of the environment, even matching the performance of incomparable oracle agents taking ground-truth maps as input.

   @article{marza2022teaching,
     bibtex_show = {true},
     abbr = {IROS},
     author = {Marza, Pierre and Matignon, La{\"{e}}titia and Simonin, Olivier and Wolf, Christian},
     title = {Teaching Agents how to Map: Spatial Reasoning for Multi-Object Navigation (Winning entry of the MultiON Challenge at CVPR 2021)},
     journal = {International Conference on Intelligent Robots and Systems (IROS)},
     year = {2022},
     html = {https://pierremarza.github.io/projects/teaching_agents_how_to_map/},
     pdf = {https://arxiv.org/abs/2107.06011},
     code = {https://github.com/PierreMarza/teaching_agents_how_to_map}
   }

2. An experimental study of the vision-bottleneck in VQA

   Pierre Marza, Corentin Kervadec, Grigory Antipov, Moez Baccouche, Christian Wolf

   arXiv 2022

   Abs Bib PDF

   As in many tasks combining vision and language, both modalities play a crucial role in Visual Question Answering (VQA). To properly solve the task, a given model should both understand the content of the proposed image and the nature of the question. While the fusion between modalities, which is another obviously important part of the problem, has been highly studied, the vision part has received less attention in recent work. Current state-of-the-art methods for VQA mainly rely on off-the-shelf object detectors delivering a set of object bounding boxes and embeddings, which are then combined with question word embeddings through a reasoning module. In this paper, we propose an in-depth study of the vision-bottleneck in VQA, experimenting with both the quantity and quality of visual objects extracted from images. We also study the impact of two methods to incorporate the information about objects necessary for answering a question, in the reasoning module directly, and earlier in the object selection stage. This work highlights the importance of vision in the context of VQA, and the interest of tailoring vision methods used in VQA to the task at hand.

   @article{marza2022vision_vqa,
     bibtex_show = {true},
     author = {Marza, Pierre and Kervadec, Corentin and Antipov, Grigory and Baccouche, Moez and Wolf, Christian},
     title = {An experimental study of the vision-bottleneck in VQA},
     journal = {arXiv},
     year = {2022},
     pdf = {https://arxiv.org/abs/2202.06858}
   }

2021

1. Patent

   A device and method for image processing

   Sean Moran, Pierre Marza, Steven McDonagh, Sarah Parisot, Gregory Slabaugh

   2021

   PDF

2020

1. CVPR

   DeepLPF: Deep Local Parametric Filters for Image Enhancement

   Sean Moran, Pierre Marza, Steven McDonagh, Sarah Parisot, Gregory Slabaugh

   In Computer Vision and Pattern Recognition (CVPR) 2020

   Abs Bib PDF Code

   Digital artists often improve the aesthetic quality of digital photographs through manual retouching. Beyond global adjustments, professional image editing programs provide local adjustment tools operating on specific parts of an image. Options include parametric (graduated, radial filters) and unconstrained brush tools. These highly expressive tools enable a diverse set of local image enhancements. However, their use can be time consuming, and requires artistic capability. State-of-the-art automated image enhancement approaches typically focus on learning pixel-level or global enhancements. The former can be noisy and lack interpretability, while the latter can fail to capture fine-grained adjustments. In this paper, we introduce a novel approach to automatically enhance images using learned spatially local filters of three different types (Elliptical Filter, Graduated Filter, Polynomial Filter). We introduce a deep neural network, dubbed Deep Local Parametric Filters (DeepLPF), which regresses the parameters of these spatially localized filters that are then automatically applied to enhance the image. DeepLPF provides a natural form of model regularization and enables interpretable, intuitive adjustments that lead to visually pleasing results. We report on multiple benchmarks and show that DeepLPF produces state-of-the-art performance on two variants of the MIT-Adobe 5k dataset, often using a fraction of the parameters required for competing methods.

   @inproceedings{moran2020deeplpf,
     bibtex_show = {true},
     abbr = {CVPR},
     author = {Moran, Sean and Marza, Pierre and McDonagh, Steven and Parisot, Sarah and Slabaugh, Gregory},
     title = {DeepLPF: Deep Local Parametric Filters for Image Enhancement},
     booktitle = {Computer Vision and Pattern Recognition (CVPR)},
     year = {2020},
     pdf = {https://openaccess.thecvf.com/content_CVPR_2020/html/Moran_DeepLPF_Deep_Local_Parametric_Filters_for_Image_Enhancement_CVPR_2020_paper.html},
     code = {https://github.com/sjmoran/DeepLPF}
   }