Efficient inference offloading for mixture-of-experts large language models in internet of medical things

• المؤلفون الرئيسيون: Yuan, Xiaoming, Kong, Weixuan, Luo, Zhenyu, Xu, Minrui
• مؤلفون آخرون: School of Computer Science and Engineering
• التنسيق: مقال
• اللغة: English
• منشور في: 2024
• الموضوعات: Computer and Information Science; Large language models; Efficient inference offloading
• الوصول للمادة أونلاين: https://hdl.handle.net/10356/179743
• المؤسسة: Nanyang Technological University

Despite recent significant advancements in large language models (LLMs) for medical services, the deployment difficulties of LLMs in e-healthcare hinder complex medical applications in the Internet of Medical Things (IoMT). People are increasingly concerned about e-healthcare risks and privacy prote...