Google DeepMind把手语变成了输入法,在Pixel 11上直接打手语就能发消息,比打字还快,聋人群体有福了。
Google DeepMind发布SL2T模型,将美国手语转成英语文本。该功能落地在Pixel 11的Gboard和Live Transcribe中,手语替代键盘打字。SL2T的测试者反馈,手语输入比英语打字更快。SL2T在Pixel 11上仅设备端追踪手、脸和身体关键点,视频不会被保留。项目由聋人谷歌员工Sam Sepah发起,并与聋人社群协作完成。
Google DeepMind just shipped a model that lets people sign into a Pixel 11 instead of typing. SL2T ...
Google DeepMind just shipped a model that lets people sign into a Pixel 11 instead of typing. SL2T starts with ASL-to-English in Gboard and Live Transcribe. Testers said signing was faster than typing in English. To keep the camera feed private, the phone tracks points on the hands, face, and body on-device and discards the video. Sam Sepah, a Deaf Googler, originated the project. Demis Hassabis: “Built in close collaboration with the Deaf community, it’s a great example of the good that can be done with AI.” Google DeepMind @GoogleDeepMind SL2T is our breakthrough sign language-to-text model powering new features for Deaf and hard of hearing users on @Android . Starting with American Sign Language-to-English on Pixel 11, people can sign directly into Gboard and Live Transcribe instead of typing. Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 0 🔄 0 ❤️ 2 👀 1807 📊 1 ⚡