Martin Guay



I'm currently working on Neural Animation Tools: a novel class of deep learning-based posing and motion authoring tools and real-time controllers.

Cloth
Cloth


In 2019, I initiated the "computer vision for marker-less capture and in-camera VFX" project where we built a world-class RGB human tracker, multi-camera marker-less motion capture system, as well as real-time actor augmentation for previs using human segmentation.

On the left we see our marker-less mocap results using 3 cameras, and on the right tracking results for Lion King.


Cloth
Cloth



Neural Motion / Neurak Graphics



Cloth
Generalized Pose Space Embeddings for Fine Tuning In-the-Wild using Anaylis-by-Synthesis arxiv, 2022.
Dominik Borer, Jakob Buhmann, Martin Guay
PaperVideo


Cloth
High Resolution Rig-space Neural Rendering arxiv, 2019.
Dominik Borer, Jakob Buhmann, Martin Guay
PaperVideo


Variational Autoencoder Applied to Human Walking Motion: Automatically Learning an Intuitive Animation Interface from a Collection of Human Motion Clips
Computer Graphics, Visualization, Computer Vision and Image Processing (CGVCVIP), 2016.
Marcel Ludi, Martin Guay, Brian McWilliams, Robert W. Sumner


Tracking and Augmented Reality


Cloth

Augmenting Cats and Dogs
Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP), 2021.
D. Borer, N. Isik, J. Buhmann, M. Guay
PaperVideo


Cloth


Tracking with Synthetic or Real Humans? Getting the Best of Both Worlds, arxiv, 2019.
Jakob Buhmann, Dominik Borer, Martin Guay


Cloth

AR Costumes: Automatically Augmenting Watertight Costumes from a single RGB Image
ACM SIGGRAPH Conference on Virtual Reality and Applications in Industry (VRCAI), 2018.
Christoph Maurhofer, Gokcen Cimen, Mattia Ryffel, Robert W. Sumner, Martin Guay
PaperVideo


Cloth

AR Poser: Automatically Augmenting Mobile Pictures with Digital Avatars Imitating Poses
Computer Graphics, Visualization, Computer Vision and Image Processing (CGVCVIP), 2018.
Gokcen Cimen, Christoph Maurhofer, Robert W. Sumner, Martin Guay
PaperVideo


Cloth

Modeling Physical Interactions with Real World Objects:
Interacting with Intelligent Characters in AR

Workshop on Artificial Intelligence in Virtual and Augmented Reality, 2017.
Gokcen Cimen, Ye Yuan, Stelian Coros, Robert W. Sumner, Martin Guay



Inverse Dynamics and Control of Simulations



Cloth


Keys-to-Sim: Transferring Hand-Crafted Key-framed Animations to Simulated Figures using Wide Band Stochastic Trajectory Optimization
Computer Graphics and Visual Computing (CGVC), 2018.
Dominic Borer, Robert W. Sumner, Martin Guay
PaperVideoOnline Policy Learning PDFOnline Policy Video




Using Model-based Inverse Dynamics for live-Pupetteering a 3D Character with a Tail
Computer Graphics, Visualization, Computer Vision and Image Processing (CGVCVIP), 2017.
Gokcen Cimen, Martin Guay, Stelian Coros, Robert W. Sumner


Cloth

Exploring AR and VR interactions with a fully Simulated SIMBICON 3D Character
Encyclopedia of Computer Graphics and Games, 2018.
Dominic Borer, Simone Giguarri, Robert W. Sumner, Martin Guay



Delivering Interactive 3D Performances


Cloth

Designing Interactive Performance of a 3D Conversation Avatar
Computer Graphics, Visualization, Computer Vision and Image Processing (CGVCVIP), 2018.
Dominik Borer, Dominic Lutz, Robert W. Sumner, Martin Guay




Automatic Animation of a Digital Band from Midi Signals for Live Karaoke
Live Demo @ Symposium on Computer Animation (SCA), 2016.
Renzo Roth & CGL Ph.D. Students, Martin Guay



3D Motion Authoring Tools with Built-in Artistic Principles



The Line of Action: an Intuitive Interface for Expressive Character Posing
SIGGRAPH Asia 2013.
Martin Guay, Marie-Paule Cani, Remi Ronfard





Space-time sketching of character animation
SIGGRAPH 2015.
Martin Guay, Remi Ronfard, Michael Gleicher, Marie-Paule Cani



Adding dynamics to sketch-based character animation
Sketch-based modeling and interfaces (SBIM) 2015.
Martin Guay, Remi Ronfard, Michael Gleicher, Marie-Paule Cani




Authoring Motion Cycles
Symposium on Computer Animation (SCA), 2017.
Loïc Ciccone, Martin Guay, Mauri Nitti, Robert W. Sumner



Flow Curves: an Intuitive Interface for Coherent Scene Deformation
Pacific Graphics, 2016.
Loïc Ciccone, Martin Guay, Robert W. Sumner


Cloth

Programmable Animation Texturing using Motion Stamps
Pacific Graphics, 2016.
Antoine Milliez, Martin Guay, Marie-Paule Cani, Markus Gross, Robert W. Sumner



Fast Simulations on the GPU




Simple and Fast Fluids
GPU Pro 2, 2011.
Martin Guay, Fabrice Colin, Richard Egli






Simple rasterization-based liquids
GPU PRo 5, 2013.
Martin Guay



Cloth

Screen space animation of fire
SIGGRAPH Asia, 2011.
Martin Guay, Fabrice Colin, Richard Egli




Multi-dimensional Unconditionally Stable Alternate Direction Explict (ADE) Scheme for the Convection-Diffusion Equation
Conference on Nonlinear Evolution Equations and Wave Phenomena: Computation and Theory, 2010.
Martin Guay, Fabrice Colin, Richard Egli



Video Games







A Game of Thrones: Genesis (PC)
Cyanide Studio Montreal, 2011.








Blood Bowl
Cyanide Studio Montreal, 2009.