Simon Stepputtis

About

I am a Postdoctoral Fellow at Carnegie Mellon University’s Robotics Institute, where I am part of the Advanced Agent-Robotics Technology Lab led by Prof. Katia Sycara. As part of the lab, I mainly work on Human-Agent Teaming and Machine Learning, investigating how humans and robots can efficiently collaborate in complex scenarios by analyzing the underlying concepts of trust and coordination. Before this, I received a B.Sc and M.Sc. in Engineering and Computing from the TU Bergakademie Freiberg in Germany and a Ph.D. in Computer Science from Arizona State University. During my Ph.D., I worked in the Interactive Robotics Lab led by Dr. Heni Ben Amor.

My research is centered around robotics, where I focus on multimodal manipulation, as well as scene understanding, by utilizing various modalities, including language, vision, and tactile sensing. Most notably, I am building methods utilizing neuro-symbolic approaches that allow for improved interpretability, robustness, and flexibility, allowing my methods to be understood by humans and adaptable to new situations, tasks, and domains even after their initial training. These are crucial capabilities that are achieved by bridging the gap between the opaque but strong inference capabilities of neural networks and accurate, but difficult to design symbolic reasoning approaches. Ultimately, I aim to design the next generation of assistive robots that intelligently and effectively navigate everyday tasks in complex environments by utilizing relevant domain knowledge.

Experience

  • Postdoctoral Fellow (2022 - now)

  • Resident @ X (Summer 2021)

    • X, The Moonshot Factory
    • As a resident at Goolge X, the moonshot factory, I worked on industrial manipulation tasks for Intrinsic, a robotics software and AI project at Google X.
  • Graduate Service Assistant (2017 - 2021)

    • Arizona State University
    • During my Ph.D., I worked as a teaching and research assistant on various occasions in the Interactive Robotics Lab led by Dr. Heni Ben Amor.

Education

  • Ph.D. Computer Science (2017 - 2021)

    • Arizona State University, USA
    • Thesis: Multimodal Robot Learning for Grasping and Manipulation
  • M.Sc. Engineering & Computing (2015 - 2016)

    • Technische Universität Freiberg, Germany
    • Thesis: A data-driven approach for triadic interactions in human-robot interaction
  • B.Sc. Engineering & Computing (2011 - 2015)

    • Technische Universität Freiberg, Germany
    • Thesis: Upper body tracking for avatar visualization in HMD-based virtual reality