TalkiSign – a multimodal communication aid
TalkiSign is a multimodal communication aid under development for children and adults who cannot use spoken language as their primary form of communication. We are currently conducting pilot trials with the app, in close collaboration with users, families, and professionals.
Multimodal communication with signs and symbols
The purpose of TalkiSign is to combine signs, symbols, and spelling so the user can freely combine and vary them throughout communication, without having to switch between multiple different apps.
The core feature of TalkiSign is camera-based sign recognition, where the user makes a sign in front of the camera, which the app recognizes and finds a corresponding word for. The recognized word can be displayed as both text and symbol, with the option to be read aloud using synthetic speech.
Developed together with users for users
TalkiSign is developed in close collaboration with the people the app is designed to help. Through pilots with users, families, and professionals, we ensure that the app meets the various functional needs required in everyday life.
TalkiSign is currently available in our early access programme, and it is still possible to become one of our pilot partners. In the pilot programme, the user records their own catalog of signs, which we continuously work to optimize the app’s recognition of. Participating in the pilot programme requires no special technical skills, and we continuously adjust the app based on feedback from test users. We prioritize security and do not share the user’s personal signs with other users, nor do we use personal data to train general AI models.
Flexible communication aid
TalkiSign offers a range of different features, each designed to ease communication for non-verbal language users. Get an overview of some of the app’s key features right here.
01
Recognition of more than 500 standard signs
TalkiSign’s camera-based sign recognition identifies 500+ standard signs and translates them into text, symbols, or speech, tailored to the user’s needs and functional level.
02
Add the user’s personal and customized signs
Translate personal or customized signs from video on your phone or tablet.
03
Sharing data within the network
Easily and securely share personal vocabulary across the user’s entire network, making it simple to collaborate on language training regardless of context and location.
04
Security from day one
Your data is secure with a GDPR-compliant solution, 100% hosted in Europe.
Supported by Innovation Fund Denmark
This project is partially funded by Innovation Fund Denmark under the Innofounder program.
Innovation Fund Denmark invests in entrepreneurs, researchers, and companies that create value for Denmark and new solutions to society’s biggest challenges. The fund supports the development of new knowledge and technology, leading to strengthened research and innovative solutions to benefit growth and employment in Denmark.