Overview
SignTown is an AI sign-language learning web game launched through a collaboration among the Centre for Sign Linguistics and Deaf Studies at The Chinese University of Hong Kong, The Nippon Foundation, Google, and Kwansei Gakuin University. It is designed for users interested in sign language and Deaf culture. Beginner learning is placed inside a virtual town, so users understand sign through everyday communication tasks rather than only watching and memorizing movements. Users join with a computer browser and camera, follow task demos to produce signs, and receive AI feedback on their motions. Recognition looks at handshape and also body posture and facial expression, without special gloves or three-dimensional camera equipment. Core features — Daily-life quests: in scenes such as ordering food or finding lodging, communicate with villagers in sign and complete tasks so vocabulary is learned in concrete situations. AI motion feedback: practice demo movements toward the camera; the system recognizes hand, body, and face features and responds on accuracy to support repeated practice. Two sign languages: learn Hong Kong Sign Language and Japanese Sign Language, and switch between them to see how the same communicative need is expressed in different regions. Culture and badge exploration: collect commemorative badges by producing signs correctly, and learn about Deaf cultures in different regions inside the game to add exploration goals. Who it is for — users who want to try sign-language basics through an interactive game; people interested in Hong Kong Sign Language, Japanese Sign Language, and Deaf culture; players who want camera-based AI motion recognition. How to use — open the game on a computer with a camera.
Connected profiles
Sources · 0Sources & provenance
English text is maintained separately from the original record. Consult the original source before citing a fact.
No source links are available for this profile.
Original source text
Names may use phonetic renderings when no English name is supplied. The original wording is retained below.
SignTown 手语村是香港中文大学手语及聋人研究中心、日本财团、Google 与关西学院大学合作推出的 AI 手语学习网页游戏，面向对手语和聋人文化感兴趣的用户。它将入门学习放进虚拟小镇，让用户通过日常交流任务理解手语，而不只是观看和记忆动作。用户使用电脑浏览器和摄像头即可参与，跟随任务示范打出手语，由 AI 判断动作并给出反馈。识别不仅关注手形，还结合身体姿势和面部表情，无需佩戴专用手套或使用三维摄像设备。核心功能生活情境闯关：在点餐、寻找住宿等场景中，用手语与村民交流并完成任务，将词汇学习放进具体生活情境。AI 动作反馈：对着摄像头练习示范动作，系统识别手部、身体及面部特征，并对手语准确度作出回应，帮助用户反复练习。双手语学习：支持学习香港手语和日本手语，用户可切换不同手语，了解同一交流需求在不同地区的表达方式。文化与徽章探索：通过正确打出手语收集纪念徽章，并在游戏中了解不同地区的聋人文化，为学习增加探索目标。适合谁想通过互动游戏尝试手语入门的用户。对香港手语、日本手语及聋人文化感兴趣的人。希望体验摄像头与 AI 动作识别互动的玩家。使用方式使用配备摄像头的电脑打开游戏。