Nature Communications (Oct 2022)
Ultrathin crystalline-silicon-based strain gauges with deep learning algorithms for silent speech interfaces
- Taemin Kim,
- Yejee Shin,
- Kyowon Kang,
- Kiho Kim,
- Gwanho Kim,
- Yunsu Byeon,
- Hwayeon Kim,
- Yuyan Gao,
- Jeong Ryong Lee,
- Geonhui Son,
- Taeseong Kim,
- Yohan Jun,
- Jihyun Kim,
- Jinyoung Lee,
- Seyun Um,
- Yoohwan Kwon,
- Byung Gwan Son,
- Myeongki Cho,
- Mingyu Sang,
- Jongwoon Shin,
- Kyubeen Kim,
- Jungmin Suh,
- Heekyeong Choi,
- Seokjun Hong,
- Huanyu Cheng,
- Hong-Goo Kang,
- Dosik Hwang,
- Ki Jun Yu
Affiliations
- Taemin Kim
- Functional Bio-integrated Electronics and Energy Management Lab, School of Electrical and Electronic Engineering, Yonsei University
- Yejee Shin
- Medical Artificial Intelligence Lab, School of Electrical and Electronic Engineering, Yonsei University
- Kyowon Kang
- Functional Bio-integrated Electronics and Energy Management Lab, School of Electrical and Electronic Engineering, Yonsei University
- Kiho Kim
- Functional Bio-integrated Electronics and Energy Management Lab, School of Electrical and Electronic Engineering, Yonsei University
- Gwanho Kim
- Functional Bio-integrated Electronics and Energy Management Lab, School of Electrical and Electronic Engineering, Yonsei University
- Yunsu Byeon
- Medical Artificial Intelligence Lab, School of Electrical and Electronic Engineering, Yonsei University
- Hwayeon Kim
- Digital Signal Processing & Artificial Intelligence Lab, School of Electrical and Electronic Engineering, Yonsei University
- Yuyan Gao
- Department of Engineering Science and Mechanics, The Pennsylvania State University
- Jeong Ryong Lee
- Medical Artificial Intelligence Lab, School of Electrical and Electronic Engineering, Yonsei University
- Geonhui Son
- Medical Artificial Intelligence Lab, School of Electrical and Electronic Engineering, Yonsei University
- Taeseong Kim
- Medical Artificial Intelligence Lab, School of Electrical and Electronic Engineering, Yonsei University
- Yohan Jun
- Medical Artificial Intelligence Lab, School of Electrical and Electronic Engineering, Yonsei University
- Jihyun Kim
- Digital Signal Processing & Artificial Intelligence Lab, School of Electrical and Electronic Engineering, Yonsei University
- Jinyoung Lee
- Digital Signal Processing & Artificial Intelligence Lab, School of Electrical and Electronic Engineering, Yonsei University
- Seyun Um
- Digital Signal Processing & Artificial Intelligence Lab, School of Electrical and Electronic Engineering, Yonsei University
- Yoohwan Kwon
- Digital Signal Processing & Artificial Intelligence Lab, School of Electrical and Electronic Engineering, Yonsei University
- Byung Gwan Son
- Digital Signal Processing & Artificial Intelligence Lab, School of Electrical and Electronic Engineering, Yonsei University
- Myeongki Cho
- Functional Bio-integrated Electronics and Energy Management Lab, School of Electrical and Electronic Engineering, Yonsei University
- Mingyu Sang
- Functional Bio-integrated Electronics and Energy Management Lab, School of Electrical and Electronic Engineering, Yonsei University
- Jongwoon Shin
- Functional Bio-integrated Electronics and Energy Management Lab, School of Electrical and Electronic Engineering, Yonsei University
- Kyubeen Kim
- Functional Bio-integrated Electronics and Energy Management Lab, School of Electrical and Electronic Engineering, Yonsei University
- Jungmin Suh
- Functional Bio-integrated Electronics and Energy Management Lab, School of Electrical and Electronic Engineering, Yonsei University
- Heekyeong Choi
- Functional Bio-integrated Electronics and Energy Management Lab, School of Electrical and Electronic Engineering, Yonsei University
- Seokjun Hong
- Functional Bio-integrated Electronics and Energy Management Lab, School of Electrical and Electronic Engineering, Yonsei University
- Huanyu Cheng
- Department of Engineering Science and Mechanics, The Pennsylvania State University
- Hong-Goo Kang
- Digital Signal Processing & Artificial Intelligence Lab, School of Electrical and Electronic Engineering, Yonsei University
- Dosik Hwang
- Medical Artificial Intelligence Lab, School of Electrical and Electronic Engineering, Yonsei University
- Ki Jun Yu
- Functional Bio-integrated Electronics and Energy Management Lab, School of Electrical and Electronic Engineering, Yonsei University
- DOI
- https://doi.org/10.1038/s41467-022-33457-9
- Journal volume & issue
-
Vol. 13,
no. 1
pp. 1 – 12
Abstract
Designing an efficient platform that enables verbal communication without vocalization remains a challenge. Here, the authors propose a silent speech interface by utilizing a deep learning algorithm combined with strain sensors attached near the subject’s mouth, able to collect 100 words and classify at a high accuracy rate.