We’ve been promised a future filled with autonomous vehicles, mixed reality, robotics, and smart homes. However, to deliver on this, our software needs to be able to easily translate our physical presence into the digital space. From autonomous vehicles ‘seeing’ pedestrians as crude bounding boxes to virtual reality experiences still relying on controllers for basic body tracking, it’s evident that our technology is not yet fully ‘human aware.’
copyright by www.bodylabs.com
Computers need to understand how we’re shaped and the way we move. On June 1st, we’re announcing the launch of SOMA , the first human-aware artificial intelligence platform that can accurately predict 3D human shape and motion from everyday photos or videos. With SOMA, we look to enable brands and developers to easily capture 3D human shape and motion to power a range of applications. Built on a statistical model
At the core of SOMA is our statistical understanding of 3D human shape that’s trained using thousands of 3D scans and motion data. We use our statistical approach to make a template 3D mesh of the human body that can align to any data source. By first understanding the 3D human body statistically, we can then begin to unravel the complete range of body types and the full constraints of natural human movement. Unlocking the smartphone with convolutional neural networks
Previously, our statistical approach used emerging 3D scanning or consumer depth sensing technology as primary inputs. By now combining our statistical understanding with convolutional neural networks, we can accurately predict major joints, toes, facial features, and 3D body shape using everyday photos or videos. This unlocks advanced computer vision, 3D modeling, accurate digital body measurements, and markerless motion capture to everyone using the devices we already own: smartphones.
We designed SOMA to run on a backend server (and later, natively on mobile devices) to empower any developer to access SOMA and integrate it within their products and services. Over the summer, we’ll be announcing a series of APIs and SDKs to enable businesses and developers to plug into SOMA. […]
We’ve been promised a future filled with autonomous vehicles, mixed reality, robotics, and smart homes. However, to deliver on this, our software needs to be able to easily translate our physical presence into the digital space. From autonomous vehicles ‘seeing’ pedestrians as crude bounding boxes to virtual reality experiences still relying on controllers for basic body tracking, it’s evident that our technology is not yet fully ‘human aware.’
copyright by www.bodylabs.com
At the core of SOMA is our statistical understanding of 3D human shape that’s trained using thousands of 3D scans and motion data. We use our statistical approach to make a template 3D mesh of the human body that can align to any data source. By first understanding the 3D human body statistically, we can then begin to unravel the complete range of body types and the full constraints of natural human movement. Unlocking the smartphone with convolutional neural networks
Previously, our statistical approach used emerging 3D scanning or consumer depth sensing technology as primary inputs. By now combining our statistical understanding with convolutional neural networks, we can accurately predict major joints, toes, facial features, and 3D body shape using everyday photos or videos. This unlocks advanced computer vision, 3D modeling, accurate digital body measurements, and markerless motion capture to everyone using the devices we already own: smartphones.
We designed SOMA to run on a backend server (and later, natively on mobile devices) to empower any developer to access SOMA and integrate it within their products and services. Over the summer, we’ll be announcing a series of APIs and SDKs to enable businesses and developers to plug into SOMA. […]
Share this: