Handwashing Detection
Developed pre-COVID. Conceptualizated, prototyped, built sensing + machine learning algorithms, and helped ship the feature into production. Apple Watch Series 4+.
My team is hiring. I have positions available for full-time senior research scientists + engineers, post-docs, and interns (all-year). I strongly encourage candidates from non-traditional and underrepresented backgrounds to apply.
Dr. Ke-Yu Chen
Research Lead
Dr. Jun Gong
Research Scientist
Richard Kang
Research Engineer
Kareem Bedri
Research Scientist (Incoming)
Dr. Carolina Brum
Senior Research Scientist (Incoming)
Fereshteh Shahmiri
Research Intern
Cathy Fang
Research Intern
Lisa Elkin
Research Intern (Incoming)
Orson Xu
Research Intern (Incoming)
We work closely with teams across Apple. Here are select features and experiences that we've had major involvement with and helped ship to production:
Developed pre-COVID. Conceptualizated, prototyped, built sensing + machine learning algorithms, and helped ship the feature into production. Apple Watch Series 4+.
Designed, built, implemented, and shipped core spatial tracking algorithms, including attention and awareness detection. Apple AirPods Pro.
Prior to Apple, I have published over 30 papers in interactive sensing and applied machine learning. My dissertation is titled: Context-Driven Implicit Interactions. The map below illustrates the breadth and depth of topics I have explored. My dissertation (purple track) is a culmination of several projects on practical, high-fidelity, and privacy-sensitive contextual sensing.
I publish at premier venues in interactive systems, sensing, and human-computer interaction. Below are highlights (note: projects have no connections with Apple unless specified). See CV for a full list.
Sensing Fine-Grained Hand Activity with Smartwatches. 2019.
Paper Video Project
Plug-and-Play Acoustic Activity Recognition. 2018.
Paper Video Project
Automatic Class Discovery and One-Class Interactions for Acoustic Activity Recognition. 2020.
Paper Video Project
LiDAR-Enabled Touch, User, and Object Sensing for IoT Experiences. 2019.
Paper Video Project
Long-Range Vibrometry for Smart Environment Sensing. 2018.
Paper Video
On-Touch Contextual Functionality for Smart IoT Appliances. 2017.
Paper Video
Passive, Acoustically-Driven, Interactive Controls for Handheld Devices. 2015.
Paper Video Project
Cheap, Small, Low-Power and Clickable Fixed-Icon Laser Projections. 2014.
Paper Video Project
Exploring Data Tracking and Sharing Preferences of Wheelchair Athletes. 2018.
Paper
Early Concept, Interaction Framework, and Sensing Techniques for Microsoft Surface Duo.
Work Done at Microsoft in 2017.
Please see Curriculum Vitae for a full list of publications.
My group's research agenda at Apple, combined with unmatched access to many of the world's most innovative products, puts us in a unique position to impact millions of people. I am looking for driven, highly creative, and highly collaborative candidates. I have positions available for interns, post-docs, and full-time research scientists + engineers. I welcome candidates with backgrounds in HCI, machine learning, electrical engineering, and related fields. I strongly encourage candidates from non-traditional and underrepresented backgrounds to apply.
My group has positions available in Pittsburgh, Seattle, and Cupertino. If interested, email me directly.
My idea of a happy life is being with family and friends, travelling, learning, and pursuing creative projects. I'm currently into photography— here a few of my favorite shots!
Apple and the Apple logo are trademarks of Apple Inc.,
registered in the U.S. and other countries.