Reporting Email Campaign Results

Keepnet Labs’ Phishing Simulator Report

Introduction
Email-based attacks are responsible for more than 90% of all cyber security breaches. Most successful attacks start with an email. Especially when a person opens the email and gives out private information, or downloads a file. Keepnet Labs which is a platform with various products to prevent email-based attacks. Phishing Simulator allows you to start an email campaign with emails that look like phishing fraud emails. The campaign report presents the data on recipients’ behavior such as opening the email or entering their passwords.
Challenge
Project’s goal is to re-design the phishing simulation campaign report that includes each recipient’s behavior as well as general stats. I lead and supervised 2 junior designers on my team for the project. We were responsible of all aspects of the design from research to final UI design.

Empathize

Who’s gonna use this? And why?

I interviewed lots of users and my colleagues who work directly with customers and gathered information on user habits, motivations, user feedback, requested features, competitor products, market needs, legal requirements, etc.

Collecting information
We interviewed users, and had conversations with our colleagues who work directly with customers, to learn about the users and their motivations.
What actions do they need to take to do their work?
What problem have they faced in the past?
What information do they expect to see?
What do they do with such information?
Competition Analysis
We examined reports from competitor products to discover possible details we fail to deliver, and explore uncharted possibilities.

Define

How do all that information come together?

We created a Figjam board on Figma and listed all possible information we needed to show and action that user need to take. We carefully defined which information and tools are crucial and needed and which are not, based on the knowledge we had from our research. We decided to remove some graphs and charts for example, because they weren’t giving any useful information.

Card sorting
We conducted a card sorting study with participation of our co-workers and actual users on Optimal Workshop, and asked them to group these information types. Optimal Workshop gives great result analysis with charts and diagrams. Using similarity matrix and dendograms, we grouped the information types to clusters.

Ideate and Wireframe

I conducted brainstorming sessions within design team to discuss best layout options. Quickly iterated wireframes to discover our possible options. We had to consider optional dynamic fields to be arranged in a way that won’t break the layout on any combination of options.

Team sessions
I conducted brainstorming sessions within design team to discuss best layout options. Quickly iterated wireframes to discover our possible options. We had to consider optional dynamic fields to be arranged in a way that won’t break the layout on any combination of options. We removed pie charts and line graphs which were found unnecessary by the users.
Key Moment
Delivery Report
Users requested to see on the report when a problem occurs delivering an email so that they would know the person had not received the email. Sometimes, due to various technical difficulties, emails may not be delivered. It proved to be no different for email campaigns prepared via Phishing Simulator. Users needed to be aware of such occasions so they can see the error details, intervene and retry sending. A re-send action is also implemented for the user’s convenience.

UI Design

We created the UI kit by putting the components together from our library. We created the interface components for stat cards at the top and widgets below it just for this feature.

Old vs New
Visual hierachy was provided via vibrant colors, contasting elements, and differentiating sizes. Colors are used to indicate statuses. Users now can have a glimps of overall status with one look, and get into the detail with a few clicks.

User testing

We created survey study on Optimal Workshop to test if user can understand the given information on example reports. We displayed an example report for every question and asked participants to select the right answer. We recruited participants from actual users and test users from Optimal Workshop’s pool of testers.


With moderated usability test, we had the chance to observe the users while using a prototype of this feature.

Results

User test result were successful and feedback we gather from users were very satisfying. We released the feature after 2 rounds of user tests and revisions.

Takeaway

This project let me to sharpen my skills as a team leader as it is my first project to lead a team bigger than 2 people. I learned the value of brainstorming and creative thinking processes, since these methods lead us to discoveries about grouping and showing such complex information.