Developing an Automatic Window Manipulation System Considering Content on Application Windows and User’s Behavior

Keisuke Yoshida; Tadachika Ozono; Toramatsu Shintani

doi:10.52731/ijscai.v1.i2.98

Keisuke Yoshida Nagoya Institute of Technology
Tadachika Ozono Nagoya Institute of Technology
Toramatsu Shintani Nagoya Institute of Technology

DOI: https://doi.org/10.52731/ijscai.v1.i2.98

Keywords: edge detection, eye-movements, user’s work behavior, window management

Abstract

Manual window managements become increased with PCs gaining larger display areas, greater processing power, and more applications. Therefore, manipulating windows accordingly and automatically helps us to perform tasks on PCs. In this study, we explored a prototype window management system called FoXpace. FoXpace uses content on application windows and user’s behavior in order to move background windows to optimal positions according to an active window. FoXpace employs edges in a desktop and user’s work history to evaluate content on application windows and user’s behavior, respectively. The edges can be obtained by using image-processing technique. The user’s work history consists of mouse clicks, keyboard inputs, and application-switches. We developed an algorithm to determine the optimal position of each windows based on edge detection and the user’s work behavior. This paper shows the development of FoXpace and its evaluations. We conducted experiments on our algorithm with questionnaires and an eye-tracking device. We concluded that our window manipulating system can reduce the cost of window manipulation while performing tasks on PCs.

References

E. W. Ishak and S. K. Feiner,“ Interacting with hidden content using contentaware free-space transparency, ”in Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology, ser. UIST ’04, 2004, pp. 189-192.

M. Waldner, M. Steinberger, R. Grasset, and D. Schmalstieg, “ Importance-driven compositing window management, ”in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ser. CHI ’11. ACM, 2011, pp. 959-968.

K. Yoshida, T. Ozono, T. Shiramatsu,“ FoXpace: Manipulating Windows Based on the User’s Work History, ”in Advanced Applied Informatics (IIAI-AAI), 2016 5th IIAI International Congress on, 2016, pp. 698–703.

G. Robertson, M. Czerwinski, P. Baudisch, B. Meyers, D. Robbins, G. Smith, and D. Tan,“ The large-display user experience, ”Computer Graphics and Applications, IEEE, vol. 25, no. 4, 2005, pp. 44-51.

D. R. Hutchings, G. Smith, B. Meyers, M. Czerwinski, and G. Robertson,“ Display space usage and window management operation comparsons between single monitor and multiple monitor users,”in Proceedings of the Working Conference on Advanced Visual Interfaces, ser. AVI ’04. ACM, 2004, pp. 32-39.

H. Shibata and K. Omura, “ Reducing the cost of window operations by docking windows, ”International Journal of Innovative Computing Information and Control, vol. 9, no. 12, 2013, pp. 4665-4679.

S. A. Bly and J. K. Rosenberg,“ A comparison of tiled and overlapping windows, ” in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ser. CHI ’86. ACM, 1986, pp. 101-106.

A. Warr, Ed H. Chi, H. Harris, A. Kusher, J. Chen, R. Flack, N. Jitkoff,“ Window Shopping: A Study of Desktop Window Switching,”in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2016, pp. 3335–3338.

D. S. Tan, B. Meyers, and M. Czerwinski,“ Wincuts: Manipulating arbitrary window regions for more effective use of screen space, ”in Proceedings of the CHI ’04 Extended Abstracts on Human Factors in Computing Systems, ser. CHI EA ’04. ACM, 2004, pp. 1525-1528.

S. Yamanaka and H. Miyashita,“Switchback cursor: mouse cursor operation for overlapped windowing, ”in Human-Computer Interaction, INTERACT 2013. Springer, 2013, pp. 746-753.

P. Dragicevic,“Combining crossing-based and paper-based interaction paradigms for dragging and dropping between overlapping windows, ”in Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology, ser. UIST ’04. ACM, 2004, pp. 193-196.

X. Bi and R. Balakrishnan,“ Comparing Usage of a Large High-Resolution Display to Single or Dual Desktop Displays for Daily Work, ”in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 2009, pp. 1005–1014.

D. R. Hutchings and J. Stasko,“ Revisiting display space management: Understanding current practice to inform next-generation design, ”in Proceedings of Graphics Interface 2004, ser. GI ’04. Canadian Human- Computer Communications Society, 2004, pp. 127-134.

K. Yoshida, Y. Niwa, T. Ozono, and T. Shintani,“ A method for improving the legibility of overlay web browsing, ”in The Institute of Electronics, Information and Communication Engineers, vol. 115, no. 381, 2015, pp. 25-30(in Japanese).