資料載入中.....
|
請使用永久網址來引用或連結此文件:
https://nccur.lib.nccu.edu.tw/handle/140.119/154250
|
| 題名: | Social Temperature: Real-Time Social Activity Monitoring Based on Deep Learning Methods |
| 作者: | 陳昭伶
Chen, Lyn Chao-Ling;Chu, Kuan-Wu;Chen, Joanna Qiong-Yue;Wang, Jerry;Su, Tim Yin-Hsiang;Chiang, Jeffrey Yun-Hung;Huang, James Wei-Chieh;Chou, Ava Ting-Yu;Chen, Chieh-Yun |
| 貢獻者: | AI中心 |
| 日期: | 2024-10 |
| 上傳時間: | 2024-11-15 |
| 摘要: | In the study, the social temperature model for measuring social activity of a space first proposed. From observations of crowd (number of people), group atmosphere (positive or negative emotion), and social interaction (conversation), the social temperature model quantizes social activity to the value of social temperature in the range of 0 to 40 degrees Celsius. A real-time camera monitoring system has developed based on deep learning methods to detect motion, human face and identity, face expression and talking voice, and provides an unconstrained social activity monitoring. Deep learning methods of GMM model, YOLOv8n model, Dlib model and Deepface model were adopted in motion detection, face detection, human identification recognition and face expression recognition, respectively. In addition, the OpenAI Whisper-small model was applied in Speech-to-Text conversion to retrieve texts data from audio signals, and Voice Activity Detector run in local devices for distinguishing speech from ambient noise of environments. For real-time computation, a GPU server was built to transfer images and voices from local devices of users via FastAPI. The system has been applied in various authentic contexts including office, school and home scenarios. The contribution of the work provides an objective way for measuring social activity of people and the belonging space in mental aspect that tries to arise people the awareness of their social states with others. |
| 關聯: | International Computer Symposium 2024 (ICS 2024), National Yang Ming Chiao Tung University, pp.230-235 |
| 資料類型: | conference |
| DOI 連結: | https://doi.org/10.1109/ICS64339.2024.00049 |
| DOI: | 10.1109/ICS64339.2024.00049 |
| 顯示於類別: | [人工智慧跨域研究中心] 會議論文
|
文件中的檔案:
| 檔案 |
描述 |
大小 | 格式 | 瀏覽次數 |
|---|
| index.html | | 0Kb | HTML | 328 | 檢視/開啟 |
|
在政大典藏中所有的資料項目都受到原著作權保護.
|
