Bio

I am a Senior Research Scientist at DeepMind. I obtained a Ph.D. from the Sierra and Willow groups. I was supervised by Simon Lacoste-Julien, Ivan Laptev and Josef Sivic. Before that, I graduated from Ecole polytechnique and Telecom ParisTech in 2015 and got a Masters Degree in Mathematics, Machine Learning and Computer Vision (MVA). My work focuses on structured learning from video and natural language. More details can be found in my resume.

Invited talks

Representation Learning from Unlabeled Narrated Videos
Computer Vision and Deep Learning Summit, Machine Can See 2020.
Learning from Narrated Videos
The 3rd Workshop on YouTube-8M Large-Scale Video Understanding, ICCV 2019.

Publications

RareAct: A video dataset of unusual interactions
Antoine Miech, Jean-Baptiste Alayrac, Ivan Laptev, Josef Sivic and Andrew Zisserman.
In arXiv
Self-Supervised MultiModal Versatile Networks
Jean-Baptiste Alayrac*, Adrià Recasens*, Rosalia Schneider*, Relja Arandjelović*, Jason Ramapuram, Jeffrey De Fauw, Lucas Smaira, Sander Dieleman, Andrew Zisserman.
To appear in NeurIPS 2020. *equal contribution.
Learning Actionness via Long-range Temporal Order Verification
Dimitri Zhukov, Jean-Baptiste Alayrac, Ivan Laptev and Josef Sivic.
In Proc. ECCV 2020.
Learning to Segment Actions from Observation and Narration
Daniel Fried, Jean-Baptiste Alayrac, Phil Blunsom, Chris Dyer, Stephen Clark, Aida Nematzadeh .
In Proc. ACL 2020.
End-to-End Learning of Visual Representations from Uncurated Instructional Videos
Antoine Miech*, Jean-Baptiste Alayrac*, Lucas Smaira, Ivan Laptev, Josef Sivic and Andrew Zisserman.
In Proc. CVPR 2020. (oral) *equal contribution.
Visual Grounding in Video for Unsupervised Word Translation
Gunnar Sigurdsson, Jean-Baptiste Alayrac, Aida Nematzadeh, Lucas Smaira, Mateusz Malinowski, Joao Carreira, Phil Blunsom and Andrew Zisserman.
In Proc. CVPR 2020.
HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clips
Antoine Miech*, Dimitri Zhukov*, Jean-Baptiste Alayrac, Makarand Tapaswi, Ivan Laptev, Josef Sivic.
In Proc. ICCV 2019. *equal contribution.
Controllable Attention for Structured Layered Video Decomposition
Jean-Baptiste Alayrac*, Joao Carreira, Relja Arandjelovic, Andrew Zisserman.
In Proc. ICCV 2019. *equal contribution.
Are Labels Required for Improving Adversarial Robustness?
Jonathan Uesato*, Jean-Baptiste Alayrac*, Po-Sen Huang*, Robert Stanforth, Alhussein Fawzi, Pushmeet Kohli.
In Proc. NeurIPS 2019. *equal contribution.
The Visual Centrifuge: Model-Free Layered Video Representations
Jean-Baptiste Alayrac*, Joao Carreira*, Andrew Zisserman.
In Proc. CVPR 2019. (oral) *equal contribution.
Cross-task weakly supervised learning from instructional videos
Dimitri Zhukov, Jean-Baptiste Alayrac, Ramazan Gokberk Cinbis, David Fouhey, Ivan Laptev, Josef Sivic.
In Proc. CVPR 2019.
A Flexible Model for Training Action Localization with Varying Levels of Supervision
Guilhem Chéron*, Jean-Baptiste Alayrac*, Ivan Laptev and Cordelia Schmid.
In NeurIPS 2018. *equal contribution.
SeaRnn: Training RNNs with Global-Local Losses
Rémi Leblond*, Jean-Baptiste Alayrac*, Anton Osokin and Simon Lacoste-Julien.
Accepted to ICLR 2018. *equal contribution.
Joint Discovery of Object States and Manipulation Actions
Jean-Baptiste Alayrac, Josef Sivic, Ivan Laptev and Simon Lacoste-Julien.
In Proc. ICCV 2017.
Learning from narrated instruction videos
Jean-Baptiste Alayrac, Piotr Bojanowski, Nishant Agrawal, Ivan Laptev, Josef Sivic and Simon Lacoste-Julien.
In TPAMI 2017 (Journal version of Unsupervised learning from narrated instruction videos)
Learning from Video and Text via Large-Scale Discriminative Clustering
Antoine Miech, Jean-Baptiste Alayrac, Piotr Bojanowski, Ivan Laptev and Josef Sivic.
In Proc. ICCV 2017 (Spotlight).
Minding the Gaps for Block Frank-Wolfe Optimization of Structured SVMs
Jean-Baptiste Alayrac*, Anton Osokin*, Isabella Lukasewitz, Puneet K. Dokania and Simon Lacoste-Julien.
In Proc. ICML 2016. *equal contribution.
Unsupervised learning from narrated instruction videos
Jean-Baptiste Alayrac, Piotr Bojanowski, Nishant Agrawal, Ivan Laptev, Josef Sivic and Simon Lacoste-Julien.
In Proc. CVPR 2016 (Oral).

PhD Thesis

Structured Learning from Videos and Language
Jean-Baptiste Alayrac

Teaching

Statistical machine learning - Master M1 - Ecole normale supérieure, TA, 2015-2016.
1M001 : Analyse et algèbre pour les sciences, Universite Pierre et Marie Curie, TA, 2014-2016.
1M004 : Calcul matriciel, Universite Pierre et Marie Curie, TA, 2014-2016.
2M223 : Algèbre bilinéaire et géométrie, Universite Pierre et Marie Curie, TA, 2014-2015.

Other projects

Simple sketch recognizer used in an exhibition at Palais de la Découverte.