Martin Guay



I'm currently working on Neural Motion Representations and Marker-Less Motion Capture for animation and vfx.

Here is our custom-made marker-less motion capture system without any manual clean-up. On the right we have some work done on tracking animals for VFX.



Cloth
Cloth
IMDB


Credit: Martin Guay, Jakob Buhmann, Dominik Borer.

Cloth


Patent: Joint Estimation from Images, 2020.
Martin Guay, Jakob Buhmann, Cengiz Oztirelli


Cloth


Patent: Training with Visual Cues for Accurate Human Tracking in RGB Images, 2020.
Martin Guay, Jakob Buhmann, Dominik Borer, Maurizio Nitti


Neural Motion / Neurak Graphics



Cloth
Generalized Pose Space Embeddings for Fine Tuning In-the-Wild using Anaylis-by-Synthesis arxiv, 2022.
Dominik Borer, Jakob Buhmann, Martin Guay
PaperVideo


Cloth
High Resolution Rig-space Neural Rendering arxiv, 2019.
Dominik Borer, Jakob Buhmann, Martin Guay
PaperVideo


Variational Autoencoder Applied to Human Walking Motion: Automatically Learning an Intuitive Animation Interface from a Collection of Human Motion Clips
Computer Graphics, Visualization, Computer Vision and Image Processing (CGVCVIP), 2016.
Marcel Ludi, Martin Guay, Brian McWilliams, Robert W. Sumner


Augmented Reality


Cloth

Augmenting Cats and Dogs
Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP), 2021.
D. Borer, N. Isik, J. Buhmann, M. Guay
PaperVideo


Cloth

AR Costumes: Automatically Augmenting Watertight Costumes from a single RGB Image
ACM SIGGRAPH Conference on Virtual Reality and Applications in Industry (VRCAI), 2018.
Christoph Maurhofer, Gokcen Cimen, Mattia Ryffel, Robert W. Sumner, Martin Guay
PaperVideo


Cloth

AR Poser: Automatically Augmenting Mobile Pictures with Digital Avatars Imitating Poses
Computer Graphics, Visualization, Computer Vision and Image Processing (CGVCVIP), 2018.
Gokcen Cimen, Christoph Maurhofer, Robert W. Sumner, Martin Guay
PaperVideo


Cloth

Modeling Physical Interactions with Real World Objects:
Interacting with Intelligent Characters in AR

Workshop on Artificial Intelligence in Virtual and Augmented Reality, 2017.
Gokcen Cimen, Ye Yuan, Stelian Coros, Robert W. Sumner, Martin Guay



Inverse Dynamics and Control of Simulations



Cloth


Keys-to-Sim: Transferring Hand-Crafted Key-framed Animations to Simulated Figures using Wide Band Stochastic Trajectory Optimization
Computer Graphics and Visual Computing (CGVC), 2018.
Dominic Borer, Robert W. Sumner, Martin Guay
PaperVideoOnline Policy Learning PDFOnline Policy Video




Using Model-based Inverse Dynamics for live-Pupetteering a 3D Character with a Tail
Computer Graphics, Visualization, Computer Vision and Image Processing (CGVCVIP), 2017.
Gokcen Cimen, Martin Guay, Stelian Coros, Robert W. Sumner


Cloth

Exploring AR and VR interactions with a fully Simulated SIMBICON 3D Character
Encyclopedia of Computer Graphics and Games, 2018.
Dominic Borer, Simone Giguarri, Robert W. Sumner, Martin Guay



Delivering Interactive 3D Performances


Cloth

Designing Interactive Performance of a 3D Conversation Avatar
Computer Graphics, Visualization, Computer Vision and Image Processing (CGVCVIP), 2018.
Dominik Borer, Dominic Lutz, Robert W. Sumner, Martin Guay




Automatic Animation of a Digital Band from Midi Signals for Live Karaoke
Live Demo @ Symposium on Computer Animation (SCA), 2016.
Renzo Roth & CGL Ph.D. Students, Martin Guay



3D Motion Authoring Tools with Built-in Artistic Principles



The Line of Action: an Intuitive Interface for Expressive Character Posing
SIGGRAPH Asia 2013.
Martin Guay, Marie-Paule Cani, Remi Ronfard





Space-time sketching of character animation
SIGGRAPH 2015.
Martin Guay, Remi Ronfard, Michael Gleicher, Marie-Paule Cani



Adding dynamics to sketch-based character animation
Sketch-based modeling and interfaces (SBIM) 2015.
Martin Guay, Remi Ronfard, Michael Gleicher, Marie-Paule Cani




Authoring Motion Cycles
Symposium on Computer Animation (SCA), 2017.
Loïc Ciccone, Martin Guay, Mauri Nitti, Robert W. Sumner



Flow Curves: an Intuitive Interface for Coherent Scene Deformation
Pacific Graphics, 2016.
Loïc Ciccone, Martin Guay, Robert W. Sumner


Cloth

Programmable Animation Texturing using Motion Stamps
Pacific Graphics, 2016.
Antoine Milliez, Martin Guay, Marie-Paule Cani, Markus Gross, Robert W. Sumner



Fast Simulations on the GPU




Simple and Fast Fluids
GPU Pro 2, 2011.
Martin Guay, Fabrice Colin, Richard Egli






Simple rasterization-based liquids
GPU PRo 5, 2013.
Martin Guay



Cloth

Screen space animation of fire
SIGGRAPH Asia, 2011.
Martin Guay, Fabrice Colin, Richard Egli




Multi-dimensional Unconditionally Stable Alternate Direction Explict (ADE) Scheme for the Convection-Diffusion Equation
Conference on Nonlinear Evolution Equations and Wave Phenomena: Computation and Theory, 2010.
Martin Guay, Fabrice Colin, Richard Egli



Video Games





A Game of Thrones: Genesis (PC)
Cyanide Studio Montreal, 2011.







Blood Bowl
Cyanide Studio Montreal, 2009.