It is essential to regularly test the usability of a learning management system, in order to ensure a fast adoption by new users and rapidly shift the focus from the platform to the content and the learning experience. Quantitative testing yields the most reliable results due to the large number of data points acquired, but lacks the in-depth analysis of the qualitative research from a controlled testing setup. We are proposing in this paper an integrated usability testing tool, which can replace a certain type of laboratory testing, where the users’ actions on the real platform are measured and analyzed. We conducted tests with the tool and compared the results with a small scale laboratory test using the same scenarios. The results seem to confirm the proposed tool as a viable alternative to the laboratory test.