Overview
“Traitify” harnesses the power of AI to imbue objects with unique personality traits, transforming them into voice assistants that foster emotional connections.
Skills
Generative AI
Innovation Design
(ID)
Inspiration
In a world brimming with cutting-edge AI technologies, most intelligent devices are purpose-built, necessitating the acquisition of new hardware. Our project challenges this norm by asking, "Why not imbue existing everyday objects with intelligence?" This approach leverages the familiarity and ubiquity of household items, transforming them into interactive partners through AI, without the need for specialized new devices.
What it does
Users first pair the Traitify hardware with the smartphone app. After successful pairing, users select the object they want to endow with personality and voice and upload it to the app. Then, they connect the hardware to the chosen object. The app will create a personality and voice for the object. At this point, users can begin communicating with the object. Additionally, users can adjust the object's personality and voice, and manage their library of objects that have already been endowed with personalities.
Video:Scenario demonstration of “Traitify” ↓
How we built it
Thanks to the efforts of the community, we have been able to develop basic prototypes using tools like Flowise, based on the LangChain framework. It’s an open source low-code tool for developers to build customized LLM orchestration flow & AI agents. By using a drag-and-drop user interface, we successfully developed a conversational agent with two LLM chains.
Our Flowise Workflow
One utilizes Gemini's multimodal capabilities to analyze images of objects provided by users and generates personalities for these objects based on MBTI personality theory.
(Object personality modelling LLM )↓
By adding an output parser node to the chain, the output of the Personality Modeling LLM is standardized using JSON file format. This data will be stored in backend and user could customised it’s personality and add stickers later.
(Data structure backend )↓
The second conversation chain uses these generated personalities as input to construct a chatbot, which become your personal assistance.
(Conversational LLM based on generated personality )↓
Video:Working demo for “Traitify” chatbot