3D reconstruction and video analytics for subsea exploration

Aaron Marburg

Ocean Engineering Department, Applied Physics Laboratory

University of Washington

amarburg_1_300  amarburg_2_300


Wednesday, December 7, 2016
Pacific Forum—11:00 a.m.

Humans are inherently visual creatures. Despite the limitations of underwater vision, video remains a critical modality for observing and interacting with the deep ocean. This talk will cover two major research themes: The first theme will present progress towards robust reconstruction of 3D environments from monocular and stereo cameras. I will show results of 3D reconstruction from ad hoc ROV video data and from camera systems developed in-house, as well as early results in fusing visual data with range information from an imaging sonar.

The second theme will involve a discussion of analytic tools for extracting data products from imagery and video sources, including geometric manipulations (e.g., image stitching and panorama generation), target tracking, and the application of machine learning techniques to challenging or repetitive data extraction problems. I will show preliminary results using machine learning to identify fauna in benthic imagery, discuss ongoing efforts to improve access to large video archives for scientific analysis, and show how to use post-processed products (panoramas and virtual reality) to engage the public with ocean science.

Print Version (PDF)

Next: January 18, Julia Sigwart


Data repository
Data policy
What is happening in Monterey Bay today?
Central and Northern California Ocean Observing System
Chemical data
Ocean float data
Slough data
Mooring ISUS measurements
Southern Ocean Data
Mooring data
M1 Mooring Summary Data
M1 Asimet
M1 Download Info
M1 EMeter
M1 Fluorometer (CeNCOOS)
Molecular and genomics data
ESP Web Portal
Seafloor mapping
Upper ocean data
Spatial Temporal Oceanographic Query System (STOQS) Data
Image gallery
Video library
Previous seminars
David Packard Distinguished Lecturers
Research software
Video Annotation and Reference System
System Overview
Annotation Interface
Video Tape User Guide
Video File User Guide
Annotation Glossary
Query Interface
Basic User Guide
Advanced User Guide
Query Glossary
VARS Publications
Oceanographic Decision Support System
MB-System seafloor mapping software
How to Download and Install MB-System
MB-System Documentation
MB-System Announcements
MB-System Announcements (Archive)
MB-System FAQ
MB-System Discussion Lists
MB-System YouTube Tutorials
Matlab scripts: Linear regressions
Introduction to Model I and Model II linear regressions
A brief history of Model II regression analysis
Index of downloadable files
Summary of modifications
Regression rules of thumb
Results for Model I and Model II regressions
Graphs of the Model I and Model II regressions
Which regression: Model I or Model II?
Matlab scripts: Oceanographic calculations
Matlab scripts: Sound velocity
Visual Basic for Excel: Oceanographic calculations
Educational resources
MBARI Summer Internship Program
2017 Summer Interns Blog
Education and Research: Testing Hypotheses (EARTH)
EARTH workshops
2016—New Brunswick, NJ
2015—Newport, Oregon
2016 Satellite workshop—Pensacola, FL
2016 Satellite workshop—Beaufort, NC
EARTH resources
EARTH lesson plans
Lesson plans—published
Lesson plans—development
Lesson drafts—2015
Lesson drafts—2016 Pensacola
Adopt-A-Float Program
Center for Microbial Oceanography: Research and Education (C-MORE) Science Kits
Sample archive