Pinned Loading

1. whisper-flamingo whisper-flamingo Public

   [Interspeech 2024] Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation

   Jupyter Notebook 48 1

2. c2kd c2kd Public

   Code for the C2KD paper (ICASSP 2023)

   Python 15 1

3. AVLnet AVLnet Public

   Code for the AVLnet (Interspeech 2021) and Cascaded Multilingual (Interspeech 2021) papers.

   Python 49 6

4. MUSIC_dataset MUSIC_dataset Public

   MUSIC Dataset from The Sound of Pixels (ECCV '18)

   116 26

5. Sound-of-Pixels Sound-of-Pixels Public

   Forked from hangzhaomit/Sound-of-Pixels

   Codebase for ECCV18 "The Sound of Pixels"

   Python 1

6. everything_at_once everything_at_once Public

   Forked from ninatu/everything_at_once

   Implementation of "Everything at Once - Multi-modal Fusion Transformer for Video Retrieval" (CVPR 2022)

   Python