Depth Pro 2: Sharp and Temporally Consistent Metric Monocular Depth

We present Depth Pro 2, an approach to estimating dense metric depth for images and video at full resolution. By analyzing prior methods for monocular depth estimation, we find that they commonly trade off temporal consistency and boundary sharpness: multi-frame methods favor consistency, single-frame methods favor sharpness. To overcome this trade-off, we train a single, scalable network that processes both images and video and predicts depth maps at native resolution. Depth Pro 2 produces depth maps that are metrically accurate, sharp, and temporally consistent all at once, outperforming…
This article has been indexed from Apple Machine Learning Research

Read the original article:

Depth Pro 2: Sharp and Temporally Consistent Metric Monocular Depth