Loading...
|
Please use this identifier to cite or link to this item:
https://nccur.lib.nccu.edu.tw/handle/140.119/154250
|
| Title: | Social Temperature: Real-Time Social Activity Monitoring Based on Deep Learning Methods |
| Authors: | 陳昭伶
Chen, Lyn Chao-Ling;Chu, Kuan-Wu;Chen, Joanna Qiong-Yue;Wang, Jerry;Su, Tim Yin-Hsiang;Chiang, Jeffrey Yun-Hung;Huang, James Wei-Chieh;Chou, Ava Ting-Yu;Chen, Chieh-Yun |
| Contributors: | AI中心 |
| Date: | 2024-10 |
| Issue Date: | 2024-11-15 |
| Abstract: | In the study, the social temperature model for measuring social activity of a space first proposed. From observations of crowd (number of people), group atmosphere (positive or negative emotion), and social interaction (conversation), the social temperature model quantizes social activity to the value of social temperature in the range of 0 to 40 degrees Celsius. A real-time camera monitoring system has developed based on deep learning methods to detect motion, human face and identity, face expression and talking voice, and provides an unconstrained social activity monitoring. Deep learning methods of GMM model, YOLOv8n model, Dlib model and Deepface model were adopted in motion detection, face detection, human identification recognition and face expression recognition, respectively. In addition, the OpenAI Whisper-small model was applied in Speech-to-Text conversion to retrieve texts data from audio signals, and Voice Activity Detector run in local devices for distinguishing speech from ambient noise of environments. For real-time computation, a GPU server was built to transfer images and voices from local devices of users via FastAPI. The system has been applied in various authentic contexts including office, school and home scenarios. The contribution of the work provides an objective way for measuring social activity of people and the belonging space in mental aspect that tries to arise people the awareness of their social states with others. |
| Relation: | International Computer Symposium 2024 (ICS 2024), National Yang Ming Chiao Tung University, pp.230-235 |
| Data Type: | conference |
| DOI 連結: | https://doi.org/10.1109/ICS64339.2024.00049 |
| DOI: | 10.1109/ICS64339.2024.00049 |
| Appears in Collections: | [人工智慧跨域研究中心] 會議論文
|
Files in This Item:
| File |
Description |
Size | Format | |
|---|
| index.html | | 0Kb | HTML | 363 | View/Open |
|
All items in 政大典藏 are protected by copyright, with all rights reserved.
|
