Bio

I am a research scientist at DeepMind. I obtained a Ph.D. from the Sierra and Willow groups. I was supervised by Simon Lacoste-Julien, Ivan Laptev and Josef Sivic. Before that, I graduated from Ecole polytechnique and Telecom ParisTech in 2015 and got a Masters Degree in Mathematics, Machine Learning and Computer Vision (MVA). My work focuses on structured learning from video and natural language. More details can be found in my resume.

Invited talks

Learning from Narrated Videos
The 3rd Workshop on YouTube-8M Large-Scale Video Understanding, ICCV 2019.

Publications

HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clips
Antoine Miech*, Dimitri Zhukov*, Jean-Baptiste Alayrac, Makarand Tapaswi, Ivan Laptev, Josef Sivic.
In Proc. ICCV 2019. *equal contribution.
Controllable Attention for Structured Layered Video Decomposition
Jean-Baptiste Alayrac*, Joao Carreira, Relja Arandjelovic, Andrew Zisserman.
In Proc. ICCV 2019. *equal contribution.
Are Labels Required for Improving Adversarial Robustness?
Jonathan Uesato*, Jean-Baptiste Alayrac*, Po-Sen Huang*, Robert Stanforth, Alhussein Fawzi, Pushmeet Kohli.
In Proc. NeurIPS 2019. *equal contribution.
The Visual Centrifuge: Model-Free Layered Video Representations
Jean-Baptiste Alayrac*, Joao Carreira*, Andrew Zisserman.
In Proc. CVPR 2019. (oral) *equal contribution.
Cross-task weakly supervised learning from instructional videos
Dimitri Zhukov, Jean-Baptiste Alayrac, Ramazan Gokberk Cinbis, David Fouhey, Ivan Laptev, Josef Sivic.
In Proc. CVPR 2019.
A Flexible Model for Training Action Localization with Varying Levels of Supervision
Guilhem Chéron*, Jean-Baptiste Alayrac*, Ivan Laptev and Cordelia Schmid.
In NeurIPS 2018. *equal contribution.
SeaRnn: Training RNNs with Global-Local Losses
Rémi Leblond*, Jean-Baptiste Alayrac*, Anton Osokin and Simon Lacoste-Julien.
Accepted to ICLR 2018. *equal contribution.
Joint Discovery of Object States and Manipulation Actions
Jean-Baptiste Alayrac, Josef Sivic, Ivan Laptev and Simon Lacoste-Julien.
In Proc. ICCV 2017.
Learning from narrated instruction videos
Jean-Baptiste Alayrac, Piotr Bojanowski, Nishant Agrawal, Ivan Laptev, Josef Sivic and Simon Lacoste-Julien.
In TPAMI 2017 (Journal version of Unsupervised learning from narrated instruction videos)
Learning from Video and Text via Large-Scale Discriminative Clustering
Antoine Miech, Jean-Baptiste Alayrac, Piotr Bojanowski, Ivan Laptev and Josef Sivic.
In Proc. ICCV 2017 (Spotlight).
Minding the Gaps for Block Frank-Wolfe Optimization of Structured SVMs
Jean-Baptiste Alayrac*, Anton Osokin*, Isabella Lukasewitz, Puneet K. Dokania and Simon Lacoste-Julien.
In Proc. ICML 2016. *equal contribution.
Unsupervised learning from narrated instruction videos
Jean-Baptiste Alayrac, Piotr Bojanowski, Nishant Agrawal, Ivan Laptev, Josef Sivic and Simon Lacoste-Julien.
In Proc. CVPR 2016 (Oral).

PhD Thesis

Structured Learning from Videos and Language
Jean-Baptiste Alayrac

Teaching

Statistical machine learning - Master M1 - Ecole normale supérieure, TA, 2015-2016.
1M001 : Analyse et algèbre pour les sciences, Universite Pierre et Marie Curie, TA, 2014-2016.
1M004 : Calcul matriciel, Universite Pierre et Marie Curie, TA, 2014-2016.
2M223 : Algèbre bilinéaire et géométrie, Universite Pierre et Marie Curie, TA, 2014-2015.

Other projects

Simple sketch recognizer used in an exhibition at Palais de la Découverte.