Martin Guay



I am currently working on real-time in-camera actor effects via human tracking, segmentation and in-painting all based on deep learning. I am also excited about unlocking new capabilities in Augmented Reality (AR). For example, automatically adding watertight costumes onto people in the camera, or having 3D digital characters sensing and interacting with the real world.

At Disney I also worked previously on character technologies such as building an interactive conversation avatar as well as the control of simulatated characters, which was useful in the recent Lion King's virtual production. I come from Canada and worked in the video games industry before taking a dive into research and developpement. I did my Master's on real-time fluid simulations such as fire and liquids running on the GPU. I then went to INRIA in France to work on 3D character animation for my Ph.D.

IMDB

Tracking Actors in-Camera during Movie Produciton


Cloth




Patent: Joint Estimation from Images, 2020.
Martin Guay, Jakob Buhmann, Cengiz Oztirelli




Cloth


Visual Aids for Human Tracking from Images, 2020.
Martin Guay, Jakob Buhmann, Dominik Borer, Maurizio Nitti





Variational Autoencoder Applied to Human Walking Motion: Automatically Learning
an Intuitive Animation Interface from a Collection of Human Motion Clips

Computer Graphics, Visualization, Computer Vision and Image Processing (CGVCVIP), 2016.
Marcel Ludi, Martin Guay, Brian McWilliams, Robert W. Sumner



Neural Rendering


Cloth




Rig-space Neural Rendering
arxiv, 2019.
Dominik Borer, Jakob Buhmann, Martin Guay
PaperVideo


Augmented Reality


Cloth

AR Costumes: Automatically Augmenting Watertight Costumes from a single RGB Image
ACM SIGGRAPH Conference on Virtual Reality and Applications in Industry (VRCAI), 2018.
Christoph Maurhofer, Gokcen Cimen, Mattia Ryffel, Robert W. Sumner, Martin Guay
PaperVideo


Cloth

AR Poser: Automatically Augmenting Mobile Pictures with Digital Avatars Imitating Poses
Computer Graphics, Visualization, Computer Vision and Image Processing (CGVCVIP), 2018.
Gokcen Cimen, Christoph Maurhofer, Robert W. Sumner, Martin Guay
PaperVideo


Cloth

Modeling Physical Interactions with Real World Objects:
Interacting with Intelligent Characters in AR

Workshop on Artificial Intelligence in Virtual and Augmented Reality, 2017.
Gokcen Cimen, Ye Yuan, Stelian Coros, Robert W. Sumner, Martin Guay



Inverse Dynamics and Control of Simulations

Cloth


Keys-to-Sim: Transferring Hand-Crafted Key-framed Animations to Simulated Figures using
Wide Band Stochastic Trajectory Optimization

Computer Graphics and Visual Computing (CGVC), 2018.
Dominic Borer, Robert W. Sumner, Martin Guay
PaperVideoOnline Policy Learning PDFOnline Policy Video




An Intuitive Interface for Human Performance Tracking with Simulated Characters
Computer Graphics, Visualization, Computer Vision and Image Processing (CGVCVIP), 2017.
Gokcen Cimen, Martin Guay, Stelian Coros, Robert W. Sumner


Cloth

Interacting with a Fully Simulated, Self-Balancing Bipedal Character in Augmented and Virtual Reality
Encyclopedia of Computer Graphics and Games, 2018.
Dominic Borer, Simone Giguarri, Robert W. Sumner, Martin Guay



3D Chat Bots and Music Bands


Cloth

Animating an Autonomous 3D Conversation Avatar

Computer Graphics, Visualization, Computer Vision and Image Processing (CGVCVIP), 2018.
Dominik Borer, Dominic Lutz, Robert W. Sumner, Martin Guay




Automatic Animation of a Digital Band from Midi Signals
Live Demo @ Symposium on Computer Animation (SCA), 2016.
Renzo Roth & CGL Ph.D. Students, Martin Guay



3D Motion Authoring Tools with Built-in Artistic Principles



The Line of Action: an Intuitive Interface for Expressive Character Posing
SIGGRAPH Asia 2013.
Martin Guay, Marie-Paule Cani, Remi Ronfard





Space-time sketching of character animation
SIGGRAPH 2015.
Martin Guay, Remi Ronfard, Michael Gleicher, Marie-Paule Cani




Adding dynamics to sketch-based character animation
Sketch-based modeling and interfaces (SBIM) 2015.
Martin Guay, Remi Ronfard, Michael Gleicher, Marie-Paule Cani





Authoring Motion Cycles
Symposium on Computer Animation (SCA), 2017.
Loïc Ciccone, Martin Guay, Mauri Nitti, Robert W. Sumner




Flow Curves: an Intuitive Interface for Coherent Scene Deformation
Pacific Graphics, 2016.
Loïc Ciccone, Martin Guay, Robert W. Sumner


Cloth
Programmable Animation Texturing using Motion Stamps
Pacific Graphics, 2016.
Antoine Milliez, Martin Guay, Marie-Paule Cani, Markus Gross, Robert W. Sumner



Fast Simulations on the GPU




Simple and Fast Fluids
GPU Pro 2, 2011.
Martin Guay, Fabrice Colin, Richard Egli






Simple rasterization-based liquids
GPU PRo 5, 2013.
Martin Guay



Cloth

Screen space animation of fire
SIGGRAPH Asia, 2011.
Martin Guay, Fabrice Colin, Richard Egli





Multi-dimensional Unconditionally Stable Alternate Direction Explict (ADE) Scheme for the Convection-Diffusion Equation
Conference on Nonlinear Evolution Equations and Wave Phenomena: Computation and Theory, 2010.
Martin Guay, Fabrice Colin, Richard Egli



Video Games





A Game of Thrones: Genesis (PC)
Cyanide Studio Montreal, 2011.







Blood Bowl
Cyanide Studio Montreal, 2009.



Students and Collaborators


Dominik Borer, Ph.D. Student on Motion Models for 3D Computer Animation
Jakob Buhmann, Post-Doc on Motion Capture
Prof. Bob Sumner, Supervisor

Past:
Christoph Maurhofer, Master's on Poser and Costumes in AR.
Gökcen Cimen, Ph.D. on Character Motion Models for Interaction in AR and VR.
Victor Cornillere, Autonomous 3D Avatar Chat Bots.
Dominic Lutz, 3D animator on chat bot avatars.
Stelian Coros, Prof. on Synthetising Quadruped Motion.
Ye Yuan, Synthetising Quadruped Motion.
Simone Guggiari, Bachelor's on Interacting with a self-Balancing Character in AR and VR.
Dominik Borer, Master's on Trajectory Optimization for Simulated Character Control
Loïc Ciccone, Ph.D. on Character Animation Authoring.
Renzo Roth, Master's on Animated Music Band.
Marcel Lüdi, Master's on Deep Learning for Character Animation.

Remi Ronfard, Ph.D. co-advisor at INRIA.
Marie-Paule Cani, Ph.D. co-advisor at INRIA.
Richard Egli, Master's advisor at Sherbrooke U.