Robots and humans: Learning, interaction, and remote operation

Sami Haddadin

Munich School of Robotics and Machine Intelligence
Technical University of Munich

© Andreas Heddergott / TU Muenchen

September 25, 2019
Pacific Forum—11:00 a.m.

Intelligent coordinated robot teams allow for the inspection of large infrastructures on land, air, water, and subsea, by combining robotic precision and speed with human intuition and abstract thinking. By recently unifying a priori system dynamics knowledge with efficient machine learning, robots are now able to learn complex manipulation tasks at a fraction of the computational power and energy within minutes instead of hours or days. Based on such abilities, smart robot assistants will play a central role in modern future industry and in our daily lives in the coming years. Using high fidelity remote telepresence combined with learning and interaction, mobile robots will extend human presence beyond physical limits, in essence becoming the human remote avatar to sense and act at a distance. By dynamically shifting the degree of autonomy depending on the task at hand—ranging from operating under full autonomy to complete control by a human via telepresence—flying robots like drones or underwater robots will enable humans a safe and immersive experience along the three spatial dimensions and beyond.

PDF version

Next: Melissa Garren, Pelagic Data Systems


Data repository
Data policy
Deep-Sea Guide
What is happening in Monterey Bay today?
Central and Northern California Ocean Observing System
Chemical data
Ocean float data
Slough data
Mooring ISUS measurements
Southern Ocean Data
Mooring data
M1 Mooring Summary Data
M1 Asimet
M1 download Info
M1 EMeter
Molecular and genomics data
ESP Web Portal
Seafloor mapping
Soundscape Listening Room
Upper ocean data
Spatial Temporal Oceanographic Query System (STOQS) Data
Image gallery
Video library
Creature feature
Deep-sea wallpapers
Previous seminars
David Packard Distinguished Lecturers
Research software
Video Annotation and Reference System
System overview
Data Use Policy
Video Tape User Guide
Video File User Guide
Annotation Glossary
Query Interface
Basic User Guide
Advanced User Guide
Query Glossary
VARS publications
VARS datasets used in publications
Oceanographic Decision Support System
MB-System seafloor mapping software
How to download and install MB-System
MB-System Documentation
MB-System Announcements
MB-System Announcements (Archive)
MB-System FAQ
MB-System Discussion Lists
MB-System YouTube Tutorials
Matlab scripts: Linear regressions
Introduction to Model I and Model II linear regressions
A brief history of Model II regression analysis
Index of downloadable files
Summary of modifications
Regression rules of thumb
Results for Model I and Model II regressions
Graphs of the Model I and Model II regressions
Which regression: Model I or Model II?
Matlab scripts: Oceanographic calculations
Matlab scripts: Sound velocity
Visual Basic for Excel: Oceanographic calculations
Educational resources
Navigating STEM careers
MBARI Summer Internship Program
2017 Summer Interns Blog
Education and Research: Testing Hypotheses (EARTH)
EARTH workshops
2016—New Brunswick, NJ
2015—Newport, Oregon
2016 Satellite workshop—Pensacola, FL
2016 Satellite workshop—Beaufort, NC
EARTH resources
EARTH lesson plans
Lesson plans—published
Lesson plans—development
Lesson drafts—2015
Lesson drafts—2016 Pensacola
Adopt-A-Float Program
Center for Microbial Oceanography: Research and Education (C-MORE) Science Kits
Science at home: Curriculum and resources
Sample archive
SciComm Resources