In my role as a UX designer at SAP, I worked on an extensive, over 9 month long project to measure the Usability of various internal application within the company.
The quick and dirty way to measure Usability called the System Usability Scale (SUS) was used to evaluate applications on a scale of 1-100. In addition to the SUS, I gathered user feedback and analyzed it in terms of positive, negative and neutral sentiment analysis and presented the findings to the application owners which then mostly culminated into application redesign projects.
User Experience Research
Usability of application evaluated by Quantifying each question answered and scoring the application on a scale of 1-100 with the SUS method.
T H E P R O C E S S - M Y R O L E
• Initialize survey process by sending out survey questionnaire to customers
• Customer communication and follow up
• Manage timeline for each survey by carefully considering the planned go-live for respective applications
• Project management and coordination
• Prepare surveys based on customer information
• Prepare Survey Recipient samples for each surveys based on user list given by customers
• Incorporate changes and modifications to the surveys as per customer requirements and communicate it with the management team
• Track each survey from the launch to the closing
• Analyze survey results - Quantitative analysis + Qualitative analysis
• Prepare reports for survey presentations
• Prepare schedule for managing survey analysis timeline and customer presentation timeline
• Manage the timelines for evaluating each application and look for things going according to the plan
Q U A N T I T A T I V E A N A L Y S I S
Q U A L I T A T I V E A N A L Y S I S
Another aspect introduced to measure usability of the application was gathering feedback from participants of the survey in terms of comments specific to the usability of the application.
The sentiment analysis was carried out by sorting each comment recieved by the participants into three buckets of positive, negative, neutral feedback and suggestions for improvement of the application.
Applications were also analysed in terms of demographics of the participants like region they belong to, role in the organization and frequency of use of the application to see correlations and discrepencies in the application specific to different user scenarios and workflows.