Track Mouse Cursor Movement and Typing Pattern to identify PC user

Idea: Track Mouse Cursor Movement and Typing Pattern to identify PC user so that customized content can be delivered.

Problem Statement: Once logged in a PC, the user practically has all the permission of the user from which he/she logged in. e.g. There could be a common login for a home PC and various family members may use it. So a child has same permissions as the parent and moreover all children has the same permissions.

Now while browsing web, an adult is getting the same Ads which are more children oriented, like video games releases, toys, adventure park tickets etc.. and children are getting content for Flight offers, Car, home automation, fashion, Entertainment etc. The situation can go even worse when children mistakenly search for something they heard in popular media, music or a movie and the search results are not appropriate for them.

Also, there can be a case of unintentional spending on the internet like from saved credit card etc.

Solution: There are several solutions to the above mentioned problems which are already in place like Guest/Child friendly login to the home PC, multiple profile for chrome browser etc, there can be another approach to this problem and it may well open new avenues how we treat our users.

If Windows OS can track and publish mouse cursor and keyboard typing pattern in a quantifiable way, with the help of AI models, they can be used to identify or at least categorize the user based on their age and interests.

e.g. By studying the mouse and keyboard usage pattern, AI algorithms can predict the user’s approximate age and instead of targeting him/her with fairness cream or McDonalds adverts, it can offer Nat Geo Subscription ads.

More: If this type of data can be collected and processed, it may as well help in enhancing security. The OS will be able to identify the suspicious/fake user by matching the user’s mouse and keyboard patters.

What kind of data will be good for analysis: Now here is where it goes very interesting. Typing pattern and mouse usage has huge number of permutations and combinations. Here are some examples where people use keyboard and mouse differently.

  1. Typing speed. Some people type faster than others.
  2. Mouse pointer speed.
  3. Use of Backspace. Some people tend to use more backspace because they make mistake while typing. Some people use arrow keys to correct the mistake rather than using backspace.
  4. Use of Arrow keys. This could be a real differentiating factor between users. Some people clearly use arrow keys more. Like in event of editing a mistake some people use ctrl+arrow to jump whole word, some people user arrow to naviagte single character, some people use mouse to bring cursor to the spelling mistake.
  5. Use of other keys like Caps Lock, Tab, Home, Page up/down, End, Alt+Tab, Ctrl+C etc.

Hurdles in this idea: The main problem of this approach is, it has to come from the OS. The OS needs to put extra computing power for gathering this kind of information and share it in terms of usable data.