Code supporting ImageTalk: Designing a Multimodal AAC Text Generation System Driven by Image Recognition and Natural Language Generation Using a Triple-Diamond Design Process
Abstract
Description
ImageTalk is a multimodal augmentative and alternative communication system powered by image recognition models and large language models. It assists people living with motor neuron disease in communication.
To run this web application, please navigate to ImageTalk/app/story_generation.py and replace <YOUR_API_KEY> with your OpenAI API key. Then, open a command line and type "python app.py" to run this app. A link will pop up. Please copy and paste this link to your browser and press enter to start.