Enhancing Daily Life for Alzheimer's and Dementia Patients: An AR Application with YOLO Object Recognition and ChatGPT Interaction
Open Access DepositedAbstract of Thesis Enhancing Daily Life for Alzheimer's and Dementia Patients: An AR Application with YOLO Object Recognition and ChatGPT Interaction This thesis introduces an innovative application designed to assist Alzheimer's and dementia patients, integrating augmented reality (AR), the YOLO (You Only Look Once) object recognition algorithm, and ChatGPT 3.5 via OpenAI's API. Implemented on the Microsoft HoloLens 2, this application aims to enhance the daily lives of individuals with cognitive impairments by providing interactive, contextual support directly in their local environments. The use of AR, especially within the context of Alzheimer's disease (AD), presents a significant opportunity to improve patients' training and practice regimes, potentially reducing the need for frequent visits to care facilities.The development of the application leverages Python for training the YOLO algorithm, which is crucial for real-time object recognition, enhancing the users' interaction with their surroundings. Unity game engine is utilized to craft the AR experience, creating a seamless integration of digital information within the physical world, enriched with the conversational capabilities of ChatGPT 3.5 for natural language processing. Furthermore, Microsoft Azure's services for Text to Speech and Speech to Text are employed, facilitating a more intuitive and accessible user interface. However, due to time constraints, the project did not progress to the stage of recruiting Alzheimer's and dementia patients for application testing. This limitation underscores the preliminary nature of the findings and the potential directions for future research. The application's innovative approach combines cutting-edge technologies to offer a novel solution for cognitive support, potentially transforming how patients manage their condition. By enabling practices within the patient's local environment, the technology advocates for a more autonomous and less disruptive form of care. This research contributes to the burgeoning field of technological applications in healthcare, particularly in the support of individuals with cognitive impairments, and underscores the necessity for continued development and user testing to fully realize the benefits of AR in Alzheimer's and dementia care.
- All rights reserved
Notice to Authors
If you are the author of this work and you have any questions about the information on this page, please use the Contact form to get in touch with us.
| Thumbnail | Title | Date Uploaded | Visibility | Actions |
|---|---|---|---|---|
|
|
ToushehjooLangroudi_gwu_0075M_16842.pdf | 2024-10-02 | Open Access |
|
|
Demo_Video.mp4 | 2024-10-02 | Open Access |
|