Martin Guay



Welcome !

I am Martin Guay and I am passionate about technology to enable new possibilities and help make great experiences. I shipped a few 3D games early in my career and some of my new tools have made it to movie studios such as Pixar and Industrial light and Magic (ILM).

I am currently building Neural Animation Tools using deep learning to autocomplete animations and provide markerless motion capture to animators, layout and previs.

Cloth
Cloth


In 2019, I initiated the "computer vision for marker-less capture and in-camera VFX" project where we built a world-class RGB human tracker, multi-camera marker-less motion capture system, as well as real-time actor augmentation for previs using human segmentation.

On the left we see our marker-less mocap results using 3 cameras, and on the right some animal tracking results.


Cloth
Cloth




Highlights



Cloth


SKel-IK SIGGRAPH Asia, 2023.
Dhruv Agrawal, Martin Guay, Dominik Borer, Jakob Buhmann, Robert W. Sumner
PaperVideo



The Line of Action: an Intuitive Interface for Expressive Character Posing
SIGGRAPH Asia 2013.
Martin Guay, Marie-Paule Cani, Remi Ronfard



Cloth

Modeling Physical Interactions with Real World Objects:
Interacting with Intelligent Characters in AR

Workshop on Artificial Intelligence in Virtual and Augmented Reality, 2017.
Gokcen Cimen, Ye Yuan, Stelian Coros, Robert W. Sumner, Martin Guay




Simple and Fast Fluids
GPU Pro 2, 2011.
Martin Guay, Fabrice Colin, Richard Egli



Full list of Projects and Papers



Cloth


SKel-IK SIGGRAPH Asia, 2023.
Dhruv Agrawal, Martin Guay, Dominik Borer, Jakob Buhmann, Robert W. Sumner
PaperVideo


Cloth

Data Augmentation for Robust and Reactive Neural Locmotion Controllers arxiv, 2024.
Dhruv Agrawal, Mattias Koenig, Dominik Borer, Jakob Buhmann, Robert W. Sumber, Martin Guay
PaperVideo


Cloth
Generalized Pose Space Embeddings for Fine Tuning In-the-Wild using Anaylis-by-Synthesis arxiv, 2022.
Dominik Borer, Jakob Buhmann, Martin Guay
PaperVideo


Cloth

Augmenting Cats and Dogs
Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP), 2021.
D. Borer, N. Isik, J. Buhmann, M. Guay
PaperVideo


Cloth


Tracking with Synthetic or Real Humans? Getting the Best of Both Worlds, arxiv, 2020.
Jakob Buhmann, Dominik Borer, Martin Guay


Cloth
High Resolution Rig-space Neural Rendering arxiv, 2019.
Dominik Borer, Jakob Buhmann, Martin Guay
PaperVideo




Cloth

AR Costumes: Automatically Augmenting Watertight Costumes from a single RGB Image
ACM SIGGRAPH Conference on Virtual Reality and Applications in Industry (VRCAI), 2018.
Christoph Maurhofer, Gokcen Cimen, Mattia Ryffel, Robert W. Sumner, Martin Guay
PaperVideo


Cloth

AR Poser: Automatically Augmenting Mobile Pictures with Digital Avatars Imitating Poses
Computer Graphics, Visualization, Computer Vision and Image Processing (CGVCVIP), 2018.
Gokcen Cimen, Christoph Maurhofer, Robert W. Sumner, Martin Guay
PaperVideo


Cloth

Modeling Physical Interactions with Real World Objects:
Interacting with Intelligent Characters in AR

Workshop on Artificial Intelligence in Virtual and Augmented Reality, 2017.
Gokcen Cimen, Ye Yuan, Stelian Coros, Robert W. Sumner, Martin Guay



Cloth


Keys-to-Sim: Transferring Hand-Crafted Key-framed Animations to Simulated Figures using Wide Band Stochastic Trajectory Optimization
Computer Graphics and Visual Computing (CGVC), 2018.
Dominic Borer, Robert W. Sumner, Martin Guay
PaperVideoOnline Policy Learning PDFOnline Policy Video


Variational Autoencoder Applied to Human Walking Motion: Automatically Learning an Intuitive Animation Interface from a Collection of Human Motion Clips
Computer Graphics, Visualization, Computer Vision and Image Processing (CGVCVIP), 2016.
Marcel Ludi, Martin Guay, Brian McWilliams, Robert W. Sumner



Using Model-based Inverse Dynamics for live-Pupetteering a 3D Character with a Tail
Computer Graphics, Visualization, Computer Vision and Image Processing (CGVCVIP), 2017.
Gokcen Cimen, Martin Guay, Stelian Coros, Robert W. Sumner


Cloth

Exploring AR and VR interactions with a fully Simulated SIMBICON 3D Character
Encyclopedia of Computer Graphics and Games, 2018.
Dominic Borer, Simone Giguarri, Robert W. Sumner, Martin Guay



The Line of Action: an Intuitive Interface for Expressive Character Posing
SIGGRAPH Asia 2013.
Martin Guay, Marie-Paule Cani, Remi Ronfard





Space-time sketching of character animation
SIGGRAPH 2015.
Martin Guay, Remi Ronfard, Michael Gleicher, Marie-Paule Cani



Adding dynamics to sketch-based character animation
Sketch-based modeling and interfaces (SBIM) 2015.
Martin Guay, Remi Ronfard, Michael Gleicher, Marie-Paule Cani




Authoring Motion Cycles
Symposium on Computer Animation (SCA), 2017.
Loïc Ciccone, Martin Guay, Mauri Nitti, Robert W. Sumner



Flow Curves: an Intuitive Interface for Coherent Scene Deformation
Pacific Graphics, 2016.
Loïc Ciccone, Martin Guay, Robert W. Sumner


Cloth

Programmable Animation Texturing using Motion Stamps
Pacific Graphics, 2016.
Antoine Milliez, Martin Guay, Marie-Paule Cani, Markus Gross, Robert W. Sumner




Simple and Fast Fluids
GPU Pro 2, 2011.
Martin Guay, Fabrice Colin, Richard Egli






Simple rasterization-based liquids
GPU PRo 5, 2013.
Martin Guay



Cloth

Screen space animation of fire
SIGGRAPH Asia, 2011.
Martin Guay, Fabrice Colin, Richard Egli




Multi-dimensional Unconditionally Stable Alternate Direction Explict (ADE) Scheme for the Convection-Diffusion Equation
Conference on Nonlinear Evolution Equations and Wave Phenomena: Computation and Theory, 2010.
Martin Guay, Fabrice Colin, Richard Egli



Cloth

Designing Interactive Performance of a 3D Conversation Avatar
Computer Graphics, Visualization, Computer Vision and Image Processing (CGVCVIP), 2018.
Dominik Borer, Dominic Lutz, Robert W. Sumner, Martin Guay




Automatic Animation of a Digital Band from Midi Signals for Live Karaoke
Live Demo @ Symposium on Computer Animation (SCA), 2016.
Renzo Roth & CGL Ph.D. Students, Martin Guay


Video Games







A Game of Thrones: Genesis (PC)
PC, C++ at Cyanide Studio Montreal, 2011.





iSurf on iPhone
iOS, C++ at Cyanide Studio Montreal, 2010.








Blood Bowl
XBox 360, C++ at Cyanide Studio Montreal, 2009.