Data method

As an independent institute, we always endeavour to find an objective test approach. To implement our tests, we have specialised in mystery shopping. This enables us to protect the test results from subjective blurring and ensure a solid database for industry comparison.

1. Analysis algorithm

2. Mystery test

3. Winner determination

Questions & results

1. Analysis algorithm

2. Mystery test

Response time

Question: How long does it take for a user/customer to receive a response from you?

Expected result: We measure the time it takes the company to respond to mystery enquiries*. Outstanding companies respond within 48 hours. Responses received after 7 days are no longer included in the score.

*The average values of all measurements count

Service quality

Question: Were the user’s/customer’s questions answered with sufficient service quality?

Expected result:
We measure service quality on the basis of the following objective characteristics, which are included in the assessment in descending order of weighting:

  1. The company responds to all customer enquiries, even if the request cannot be processed conclusively.
  2. The company is particularly responsive to the customer’s enquiry. In addition, relevant information is provided apart from the questions asked.
  3. The customer is notified of the receipt of their enquiry.
  4. The customer knows who they are dealing with at the company and will find further contact information in the reply.

3. Winner determination

Depending on the industry, we identify the companies with the best service. These companies set the benchmark for their sector.

The points are determined and translated into the analysis scores purely on the basis of the results from the mystery shopping. A linear scoring key with a maximum score of 100 is used for this purpose. In principle, award-winning companies have an average response time of ≤ 48 hours and a minimum quality score of 80%.

FAQs about the test procedure

Why does Fralytics rely on mystery tests?

With the help of specially conducted contacts, we are able to evaluate the service directly and quantify the results in a convincing manner.

How does the test procedure work?

Authentic enquiries about the products on offer are formulated with the help of virtual test customers. These enquiries are created in the context of new customer scenarios with the primary aim of simulating a business transaction.

Which service channels are tested in the mystery test?

Our special attention is focussed on the written communication channels. This enables us to create a precise and comparable overall picture of an entire industry.

How many enquiries are sent to the company?

At least three enquiries are made, with the exact number of enquiries varying depending on the responses received from the companies concerned. Our sophisticated algorithm is able to recognise the point at which the responses obtained lead to reliable measurement aggregation. Typically, the number of requests required is in the range of three to seven to ensure a comprehensive assessment of the service processes.

How are the enquiries structured?

The enquiries always include at least two or more questions relating to a specific product. Our main focus is not primarily on assessing the technical depth, but rather on capturing fundamental aspects of customer service. We attach particular importance to ensuring that the enquiries have been handled carefully and that they have been dealt with comprehensively. The enquiries should be able to be answered by any customer service employee of a company, even without detailed specialist knowledge of the products in question.

Does every company have the same requirements?

The enquiries are sent simultaneously to all companies, and this is done using identical questions in terms of content. In this respect, we have technological solutions that ensure equal and fair treatment. Within this framework, every company has the opportunity to win the benchmark study. The decisive factors here are the quality of the answers provided and a fast response time.

How are the responses measured and analysed?

The analysis is carried out using a hybrid approach that includes both automated technical processes and a manual check. Automated processes record key figures such as the measured response time and the receipt of confirmations. At the same time, we subject each response received to a thorough manual assessment focussing on the quality and relevance of the response.