https://doi.org/10.1051/epjconf/202532801039
Windows Sphere: Multi-Modal Operating System Control for Disability Support using Artificial Intelligence
1 Department of Information Technology, SRM Institute of Science and Technology, Ramapuram, India
2 Department of Computational Intelligence, School of Computing, SRM Institute of Science and Technology, Kattankulathur, Chennai, India
* Corresponding author: gopirajp@srmist.edu.in
Published online: 18 June 2025
Most traditional computer systems are based strongly on the standard input devices such as keyboard and mouse and they can pose a huge challenge for people with disabilities. 'Windows Sphere' is a multimodal operating system control system designed to empower individuals with disabilities through the use of artificial intelligence. Two key modules that the system integrates are: a gesture-based control module and a voice driven assistant bot F.R.I.D.A.Y. The gesture-based module allows users with partial hand functionality to operate the operating system with efficiency, thereby reducing the need for standard input devices. At the same time, F.R.I.D.A.Y., a voice recognition-based assistant, allows users without hand functionality to have seamless system control, thus enabling an offline inclusive operating experience. The system provides dual control modalities overcoming the fatigue of using a single input method by allowing additional control modalities. Additionally, the anticipated outcome of this research is a cost-effective AI driven interface that would increase accessibility and autonomy for the user however they have physical capabilities. The focus of this project is on defining a new standard for accessibility through the proposed framework, which offers great potential for extending application beyond its constraints.
© The Authors, published by EDP Sciences, 2025
This is an Open Access article distributed under the terms of the Creative Commons Attribution License 4.0, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
