Preprint – Deciphering the Transformation of Sounds into Meaning: Insights from Disentangling Intermediate Representations in Sound-to-Event DNNs. Tim Dick, Alexia Briassouli, Enrique Hortal Quesada and Elia Formisano (2024) Available at SSRN: https://ssrn.com/abstract=4979651 or http://dx.doi.org/10.2139/ssrn.4979651.
Preprint – Audio-Language Datasets of Scenes and Events: A Survey. Gijs Wijngaard, Elia Formisano, Michele Esposito, Michel Dumontier (2024) arXiv:2407.06947v1 https://arxiv.org/abs/2407.06947#
Bridging Auditory Perception and Natural Language Processing with Semantically informed Deep Neural Networks. Michele Esposito, Giancarlo Valente, Yenisel Plasencia-Calaña, Michel Dumontier, Bruno L. Giordano, and Elia Formisano (2024) Scientific Reports14, 20994 (2024). https://doi.org/10.1038/s41598-024-71693-9
Preprint – ACES: Evaluating Automated Audio Captioning Models on the Semantics of Sounds. Gijs Wijngaard and Elia Formisano and Bruno L. Giordano and Michel Dumontier (2024) arXiv, 2403.18572. https://arxiv.org/abs/2403.18572
Intermediate acoustic-to-semantic representations link behavioural and neural responses to natural sounds. Bruno L. Giordano, Michele Esposito, Giancarlo Valente, Elia Formisano (2023) Nature Neuroscience, 26(4):664-672. https://www.nature.com/articles/s41593-023-01285-9
What do we mean with sound semantics, exactly? A survey of taxonomies and ontologies of everyday sounds. Bruno L. Giordano, de Miranda Azevedo R, Plasencia-Calaña Y, Formisano E*, Dumontier M* (2022) Front Psychol. 2022 Sep 29;13:964209. https://doi.org/10.3389/fpsyg.2022.964209
Conference proceedings
ACES: Evaluating automated audio captioning models on the semantics of sounds Wijngaard G, Formisano E, Giordano B, Dumontier M, ACES: Evaluating automated audio captioning models on the semantics of sounds. Accepted at 31st European Signal Processing Conference, (EUSIPCO 2023) https://ieeexplore.ieee.org/abstract/document/10289793
Semantically informed deep neural networks for sound recognition. Michele Esposito, Giancarlo Valente, Yeni Plasencia-Calana, Bruno L. Giordanoand Elia Formisano. Presented at IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2023), Session: “Synergy between human and machine approaches to sound/scene recognition and processing” https://ieeexplore.ieee.org/document/10095606
Conference abstracts/posters/presentations
Evaluating the impact of multiscale temporal processing on sound-to-event recurrent neural networks. Michele Esposito, Bruno, L. Giordano, Giancarlo Valente, Elia Formisano (Poster Presented at Cognitive Computational Neuroscience, August 6–9, 2024, Boston, Massachusetts)
Optimal stimulus selection for dissociating acoustic and semantic processing of natural sounds. Maria Araújo Vitoria, Marie Plegat, Giorgio Marinato, Michele Esposito, Christian Herff, Bruno L. Giordano, Elia Formisano (Poster Presented at Cognitive Computational Neuroscience, August 6–9, 2024, Boston, Massachusetts)
Semantically informed deep neural networks for sound recognition. Michele Esposito, Giancarlo Valente, Yeni Plasencia-Calana, Bruno L. Giordanoand Elia Formisano. (Poster presented at International Conference on Auditory Cortex 2022)
Intermediate acoustic-to-semantic representations link behavioural and neural responses to natural sounds. Bruno L. Giordano, Michele Esposito, Giancarlo Valente, Elia Formisano (Poster presented at ICAC 2022)
Master Theses
2023-2024: Master Data Science for Decision Making. How do we recognize auditory events? Disentangling intermediate representations in the acoustic-to-semantic transformation. Tim Dick (supervision: Formisano, Briassouli, Quesada) (2024 Master program’s best thesis award)
2021-2022: Research Master Cognitive Neuroscience: The Influence of Semantics on Neural Models of Sound Recognition. Martin Bremm, (supervision: Formisano, Dumontier)
2020-2021: Research Master Cognitive Neuroscience: Opening the Black Box: Interpreting a Neural Network for Semantic Sound Recognition Using Layer-wise Relevance Propagation. Anna Vorreuther (supervision, Formisano, Valente)