Grants and Contributions:

Back to search

Title:

Capturing Machine Learned 3D Foot Shapes from a Single Camera

Agreement Number:

EGP

Agreement Value:

$25,000.00

Agreement Date:

Aug 23, 2017 -

Organization:

Natural Sciences and Engineering Research Council of Canada

Location:

Ontario, CA

Reference Number:

GC-2017-Q2-00380

Agreement Type:

Grant

Report Type:

Grants and Contributions

Additional Information:

Grant or Award spanning more than one fiscal year (2017-2018 to 2018-2019).

Recipient's Legal Name:

Zelek, John (University of Waterloo)

Program:

Engage Grants for Universities

Program Purpose:

In footwear, fit determines comfort and performance, and is highly dependent on foot shape, something that is not fully captured by shoe size. Affordable scanners based on RGBD cameras can be used to acquire more detailed sizing information, and allow for more personalized footwear matching. When scanning an object, many images from different views are usually required to reconstruct the overall shape, however prior information can be leveraged to more efficiently recreate models and fill in missing information. Deep learning methods have been shown to be able to reconstruct 3D shape from limited inputs in objects such as furniture and vehicles. This approach can be applied in 3D scanning, where a complete scan can be formed from a single input view. We apply a deep learning approach to foot scanning, and present a method to reconstruct a 3D point cloud scan from a single input depth map. Anthropomorphic body parts can be challenging compared to other objects studied in literature due to their irregular shapes, difficulty for parameterizing and limited symmetries. We will leverage MPII Human Shape models built from the CAESAR dataset to train a view synthesis based network. We will investigate using as few as one camera, either a RGB-D camera or just a RGB camera.