Page Not Found
Page not found. Your pixels are in another canvas.
Sitemap
A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.
Pages
About me
About me
Posts
Future Blog Post
Published:
This post will show up by default. To disable scheduling of future posts, edit config.yml and set future: false.
Blog Post number 4
Published:
This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.
Blog Post number 3
Published:
This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.
Blog Post number 2
Published:
This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.
Blog Post number 1
Published:
This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.
academics
education
BSc in Information Systems and Computer Engineering
Instituto Superior Técnico, September 2014 – July 2017
Final Grade Average: 18.00 / 20
Awarded three academic excellence diplomas (one for each academic year)
MSc in Advanced Computing
Imperial College London, October 2017 – October 2018
Modules: 68.2/100 (Merit)
Individual Research Project (Master’s thesis): 75/100 (Distinction)
PhD in Computing
Imperial College London, October 2019 – July 2023
Working on generative modeling and self-supervised learning on audio-visual speech.
experience
Research Assistant
Imperial College London, February 2019 – October 2019
Worked as a research assistant in the Intelligent Behaviour Understanding Group (IBUG) at Imperial College London, supervised by Maja Pantic and Björn Schuller. Developed research projects on video-to-speech synthesis and audio-visual self-supervised learning.
Teaching Assistant - Introduction to Machine Learning
Imperial College London, January 2020 – April 2020
Worked as a teaching assistant for the Introduction to Machine Learning (70050) course, led by Dr. Josiah Wang at Imperial College London.
Research Internship at Meta
Meta, August 2021 – December 2021
Developed a collaboration between my team at Meta (led by Maja Pantic) and another team at Meta Reality Labs Audio Research (led by Vamsi Krishna Ithapu), which was focused on audio-visual speech enhancement.
Part-time Researcher at Meta
Meta, March 2022 – June 2022
Continued my work in audio-visual speech enhancement from the previous internship, and developed new collaborations with other researchers.
Research Internship at Meta
Meta, June 2022 – September 2022
Continued my work in audio-visual speech enhancement from the previous internship, resulting in a new research paper: LA-VocE: Low-SNR Audio-visual Speech Enhancement using Neural Vocoders.
Research Internship at Sony R&D
Sony, September 2023 – November 2023
Developed a novel video-to-audio synthesis model, establishing a colaboration between two teams at Sony R&D.
Postdoctoral Researcher at Meta
Meta, November 2023 – Current
Developing new audio-visual speech models. My main project has been Automated Dubbing for Instagrams Reels. I have also written papers on Real-time Audio-visual Speech Enhancement (Interspeech 2024) Contextual Speech Extraction (ICASSP 2025), Unified Speech Recognition (NeurIPS 2024), Expressive Facial Animation (CVPR 2025), and others which are currently under review.
extra_curricular
Guitar, Jazz Band and Music Theory
Interartes, August 2010 – September 2015
Took classes at Interartes and played with a Jazz band for 4 years, frequently in front of live audiences. During this time I was also taught the fundamentals of Music Theory and Harmony.
STT Security Group
Instituto Superior Técnico, February 2016 – July 2017
Was a member of the Computer Software Security group (STT) representing Instituto Superior Técnico and led by professor Pedro Adão, where I frequently engaged in CTF (Capture the Flag) to score points for our team.
Landmarks - Jazz Band at Meta
Meta, March 2022 – September 2022
Organized a Jazz band with my team at Meta named Landmarks, where I played bass every week.
ASPARaGus - A Speech & Audio Reading Groupuscule
Imperial College London, March 2022 – June 2023
I attend and present in a bi-weekly research group with some of my colleagues from Imperial College London. We usually focus on deep learning applied to speech and audio. Some of my presentations (including slides) are available in the Talks section.
Squash Club
Imperial College London, January 2022 – Current
I organize a squash club with weekly matches.
online_presence
Academic Twitter Account
Published:
I started my own academic Twitter account where I regularly publish updates on my research. I find this is a good way to share my findings with the community and discover emerging research trends. I also engage in discussions with other members of the community. Overall, I find that Twitter is a great way to maintain a connection with the broader machine learning community, and I try to contribute as much as possible.
Reddit discussion - Are ResNets as good as it gets?
Published:
Posted on r/machinelearning about my experience with ResNets, and my lack of success with other recent vision models such as EfficientNet. This generated a lot of attention, and many researchers agreed with the points I made. Post has 204 upvotes (97% upvoted) and 34 comments in total. [post]
Interview with VICE - Tech Companies Are Training AI to Read Your Lips
Published:
Gave an interview for VICE, conducted by Todd Feathers, where I discussed the field of lip reading and our role as AI researchers at Imperial College London. [article]
publications
LiRA: Learning Visual Speech Representations from Audio through Self-Supervision
Pingchuan Ma and Rodrigo Mira (equal contribution), Stavros Petridis, Björn W. Schuller, Maja Pantic
Published in Interspeech, 2021
End-to-End Video-to-Speech Synthesis using Generative Adversarial Networks
Rodrigo Mira, Konstantinos Vougioukas, Pingchuan Ma, Stavros Petridis, Björn W Schuller, Maja Pantic
Published in IEEE Transactions on Cybernetics, 2022
[project page] [paper] [bib]
Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection
Alexandros Haliassos, Rodrigo Mira, Stavros Petridis, Maja Pantic
Published in CVPR, 2022
SVTS: Scalable Video-to-Speech Synthesis
Rodrigo Mira, Alexandros Haliassos, Stavros Petridis, Björn W Schuller, Maja Pantic
Published in Interspeech, 2022
[project page] [paper] [bib]
Jointly Learning Visual and Auditory Speech Representations from Raw Data
Alexandros Haliassos, Pingchuan Ma, Rodrigo Mira, Stavros Petridis, Maja Pantic
Published in ICLR, 2023
Automated composition of Galician Xota—tuning RNN-based composers for specific musical styles using deep Q-learning
Rodrigo Mira, Eduardo Coutinho, Emilia Parada-Cabaleiro, Björn W Schuller
Published in PeerJ Computer Science, 2023
LA-VocE: Low-SNR Audio-visual Speech Enhancement using Neural Vocoders
Rodrigo Mira, Buye Xu, Jacob Donley, Anurag Kumar, Stavros Petridis, Vamsi Krishna Ithapu, Maja Pantic
Published in ICASSP, 2023
[project page] [paper] [bib]
Laughing Matters: Introducing Laughing-Face Generation using Diffusion Models
Antoni Bigata Casademunt, Rodrigo Mira, Nikita Drobyshev, Konstantinos Vougioukas, Stavros Petridis, Maja Pantic
Published in BMVC, 2023
[project page] [paper] [code] [bib]
BRAVEn: Improving Self-Supervised Pre-training for Visual and Auditory Speech Recognition
Alexandros Haliassos and Andreas Zinonos (equal contribution), Rodrigo Mira, Stavros Petridis, Maja Pantic
Published in ICASSP, 2024
RT-LA-VocE: Real-Time Low-SNR Audio-Visual Speech Enhancement
Honglie Chen and Rodrigo Mira (equal contribution), Stavros Petridis, Maja Pantic
Published in Interspeech, 2024
Unified Speech Recognition: A Single Model for Auditory, Visual, and Audiovisual Inputs
Alexandros Haliassos, Rodrigo Mira, Honglie Chen, Zoe Landgraf, Stavros Petridis, Maja Pantic
Published in NeurIPS, 2024
[paper] [code] [presentation] [bib]
Contextual Speech Extraction: Leveraging Textual History as an Implicit Cue for Target Speech Extraction
Minsu Kim and Rodrigo Mira (equal contribution), Honglie Chen, Stavros Petridis, Maja Pantic
Published in ICASSP, 2025
[paper] [project page] [code] [presentation] [bib]
KeyFace: Expressive Audio-Driven Facial Animation for Long Sequences via KeyFrame Interpolation
Antoni Bigata, Michał Stypułkowski, Rodrigo Mira, Stella Bounareli, Konstantinos Vougioukas, Zoe Landgraf, Nikita Drobyshev, Maciej Zieba, Stavros Petridis, Maja Pantic
Published in CVPR, 2025
[paper] [project page] [code] [bib]
talks
Show & Tell Demo - Video-driven Speech Reconstruction using GANs
Published:
Short talk where I introduced our new video-to-speech model and showed its performance using an interactive demo. [recording] [slides]
Workshop presentation - End-To-End Video-To-Speech Synthesis using Generative Adversarial Networks with Multiple Critics”
Published:
Short talk where I presented our new end-to-end video-to-speech model (later published in IEEE Trans. on Cybernetics). [recording (presentation at 42:23, questions at 57:38)] [slides] [short paper]
Reading Group Presentation - Bootstrap your own latent, A new approach to self-supervised Learning
Published:
Short presentation where I talked about past, current and future trends in self-supervised learning, including BYOL. [slides]
Research Presentation with the President of Portugal
Published:
I presented a summary of my PhD’s research contributions to the president of Portugal, Marcelo Rebelo de Sousa, as well as many other attendees at Imperial College London. [poster] [article]
Workshop presentation - SVTS: Scalable Video-to-Speech Synthesis - Extended Abstract
Published:
Short talk where I presented our new scalable video-to-speech model (later published in Interspeech 2022). [recording (presentation at 1:34:10)] [slides] [short paper]
Reading Group Presentation - SVTS, Scalable Video-to-Speech Synthesis
Published:
Short talk where I presented our new scalable video-to-speech model (later published in Interspeech 2022). [recording] [slides]
Oral Presentation - SVTS: Scalable Video-to-Speech Synthesis
Published:
Oral presentation about our new scalable video-to-speech model (SVTS). [recording]. [slides] [paper]
Reading Group Presentation - Neural vocoders, from GANS to Diffusion models
Published:
Short presentation where I talked about neural vocoders, and how they are moving away from GANs and towards diffusion models. [slides]
Reading Group Presentation - EnCodec, High Fidelity Neural Audio Compression
Published:
Short presentation where I talked about EnCodec, a new neural codec that achieves state-of-the-art results on clean/noisy speech and music at 24/48 kHz (mono and stereo). It also has open-source code and outperforms Google’s approach - LyraV2