Skip to main content

Marketplace analytics - Stop running your business blindly


Marketplaces are emerging in every sector and the financial sector is no exception to this trend. For every product or service, for which multiple parties interact, marketplaces unfold to better match the supply and demand and improve the cooperation between the involved parties.
Marketplaces have however unique dynamics, due to their multi-facial nature, which means that the balance between the interests of the different involved parties needs to be carefully managed (i.e. achieve and conserve a critical mass for both supply and demand).

In the spirit of Peter Drucker’s teaching "If you can’t measure it, you can’t improve it", it is important to measure every aspect of the marketplace, in order to properly manage it.
Marketplace owners should be able to answer instantly several business questions, e.g.

  • What is the number of new visitors in the last X days?

  • What is the percentage of visitors turned into new (paying) customers?

  • What is the level of satisfaction of the users over time?

  • What are the different customer touch points?

  • What are the areas users get stuck?

  • What is the average lifetime value of the customers?

  • …​

In order to answer these questions, an immediate visualization of several key metrics or KPIs (= key performance indicators) is required, including the possibility to dig into the details of these metrics. These metrics should steer all decisions, allowing to make those changes to the platform that generate the most value over time. This means that each metric should be actionable (e.g. a metric like a number of transactions per day is not actionable), measured continuously and shared across business and IT, allowing everyone to work towards the same goals (different goals between IT and Business only leads to silo-thinking and conflicts of interest).

Of course, the metrics only give insights in what is currently (and in the past) going well and what is going wrong, but don’t give much info on the right plan to improve the platform. This is where techniques like canary testing and A/B testing come in the picture, allowing to see the effects on a change rapidly and in a controlled fashion.

A platform owner should also have different views on the metrics, as a marketplace can be confronted with different issues, e.g.

  • Business view: providing info if the system is supporting properly the business

  • Performance: monitoring of the technical performance of the platform, i.e. monitoring average response times, tail latencies…​ at different levels (i.e. how much time does a business process take, how much time takes an API call, how much time does a query in a database take…​)

  • Errors/Bugs: identify erroneous situations at different levels, e.g. business processes unexpectedly aborting, API calls failing, disks running full…​

  • Availability: is the platform available for end-users and what is the availability of different components (e.g. screen, API, micro-service, Docker container, server, disk…​)

  • …​

Technically metrics are collected by different tools:

  • Web metrics: a tool like Google Analytics or Adobe Analytics captures the key information of the usage of the website, collecting info like number of visitors, where are they coming from, what pages of the website are they visiting.

  • Business metrics: different solutions exist, depending on the underlying technology. Some business metrics are exposed by "Business Activity Monitors" (BAM) often built on top of a BPMS (Business Process Management System), others are custom-built in the application, while others show business dashboards created from log entries stored in e.g. ElasticSearch. Often these tools are also integrated with some kind of BI-tool (Business Intelligence) allowing to further drill-down on the metrics (e.g. Tableau, SAP BusinessObjects, QlikView, IBM Cognos analytics…​).

  • Application metrics: collect and visualize several metrics on the functioning of different components within an application. E.g. the availability of the application, the latency in different components, number of successful/failed API requests split by API…​ Also these metrics can be collected and visualized by different tools. Often such monitoring is included in middleware products like API Gateways, ESBs or BPMS systems, but often also measured via robot-based monitoring, by log analysis (e.g. ELK stack) or by exposing a few applicative metrics (captured by e.g. Prometheus).

  • Technical metrics: collect and visualize information about the health of individual pieces of software and hardware. Often this includes monitoring the availability of containers, disk space, memory and CPU usage…​ Different tools also exist to support those use cases (e.g. IBM Tivoli Monitoring).

Independent of the tooling and type of metrics, several steps are always identified to come to an actionable metric:

  • Gather the relevant data

  • Process and analyze the data (e.g. filter, aggregate…​). This can be rule-based, but machine learning techniques can also be exploited.

  • Visualize in pre-defined reports and dashboards, with possibility to drill-down

  • Act upon metrics/insights. This can be manually, but also automatically via throwing alerts (mail, SMS, Slack messages…​) or launching specific actions/processes (e.g. recycling mechanisms, restarts, disabling parts of the platform, activate back-up plans…​)

When focussing on the web and business metrics, allowing to monitor the "consumer" (= buyer/investor) and "producer" (=issuer/supplier/seller) side of a marketplace, we can identify 3 groups of metrics:

  • Usage metrics: these metrics help to understand how many people visit the platform and how they spend their time there. It will help to answer questions like where the customers found out about the marketplace, which campaigns are driving the most traffic, what are the visitor statistics…​ The 3 most important metrics in this category are:

    • Monthly Active Users (MAU): this metric counts the number of unique users who have visited the platform at least once during a certain time period. This number should be growing.

    • Bounce Rate: the bounce rate measures the percentage of users, who visit the website without any engagement (i.e. bounce right away). This number should be as low as possible (even though popular marketplaces like eBay, Amazon and Etsy also have bounce rates between 20 and 25%).

    • Time spent on site: the average time users spend on the marketplace. Normally the more time users spend on the marketplace, the more profitable. If the time is high, it is however important to drill-down to see if the long times are not caused by bottlenecks or difficult usability of the website.

  • Transaction metrics: these metrics allow to see if the delicate marketplace balance between producers and consumers is healthy. Several metrics allow to get rapid insights into this balance:

    • Liquidity: this metric expresses the expectation of a provider to sell something (= provider/seller liquidity) or of the consumer to find something he is looking for (= consumer/buyer liquidity). Typically, the liquidity is expressed via following metrics:

      • Provider/Seller liquidity: percentage of listing that result in transactions within a specific time period, i.e. "# Listings with transactions / # Total Listings". This figure should be as high as possible.

      • Consumer/Buyer liquidity: probability that a visit will turn into a transaction, i.e. "# Transactions / # Visits". This figure should be as high as possible.

      • Provider-to-consumer ratio / Buyer-to-Seller ratio / Investor-to-Issuer ratio: for this figure there is no optimal (e.g. ratio of Airbnb is 1:70, Uber is 1:50 and eBay is 1:5), but the figure is important to know where to focus on. The lower the figure, the more the platform should focus on increasing the number of producers/suppliers (while still ensure that Provider/Seller liquidity remains strong).

      • Buyer/Seller overlap: percentage of Buyers also acting as Sellers.

      • Transactions Per Buyer (TPB), i.e. "# Transactions / # Buyers".

      • Transactions Per Sellers (TPS), i.e. "# Transactions / # Sellers"

    • Repeat purchase ratio: percentage of transactions, which are repeat purchases, i.e. purchases from visitors who have already made purchases on the marketplace. This metric should be as high as possible, if the Quick Ratio is not dropping (avoid that only a few very loyal and active customers remain).

    • Quick ratio: percentage of new and resurrected users (i.e. users which did not have any activity for a long time but became active again) versus churned users. This metric should also be as high as possible (showing an increase of active users)

  • Business Metrics: the business metrics express how the marketplace is doing financially and answer questions like how much money did the marketplace make today, what is the average transaction amount…​ The most important metrics are:

    • Gross Merchandise Volume (GMV): total sales value of products or services through the marketplace during a specific time period.

    • Total marketplace revenue: the total commission generated by the marketplace

    • Take Rate (Rake): percentage of the Gross Merchandise Value captured by the marketplace, i.e. (Average) Take Rate % = GMV / Total marketplace revenue

    • Average Order Value (AOV): the average value of 1 transaction, i.e. AOV = GMV / # Transactions. This figure gives an indication of the type of transaction which are done.

    • Average items sold per order: the number of items executed in 1 transaction (e.g. via a shopping cart), i.e. # Items sold / # Transactions

    • Average amount of repurchases: number of repurchases a customer will do on average.

    • Customer Acquisition Cost (CAC): price paid to acquire a new customer (i.e. marketing, support/community management, increased infrastructure cost…​). This number should be as low as possible, featuring an organic growth of the marketplace. Check out my blog on Customer Acquisition for more info (https://bankloch.blogspot.com/2020/06/customer-acquisition-cost-probably-most.html)

    • Customer Lifetime Value (CLV): average total amount of revenue expected from a customer. CLV = AOV * Average amount of repeat purchases

Apart from the above metrics, which can be automatically measured, it is also important to understand why certain metrics behave as they behave. In-depth analysis and trial-and-error mechanisms (like A/B testing and Canary testing) can help with that, but it’s also important to talk to the users, via user groups and surveys. This can be unstructured, but in order to monitor it’s also important to get certain actionable metrics, i.e. so-called "User Satisfaction Metrics". These metrics can be collected via specialized online tools, like UserReport, UserVoice, Qualaroo or SurveyMonkey. 2 metrics are often used to express user satisfaction:

  • Net Promoter Score (NPS): for this score, users are asked how likely they would recommend the marketplace to a friend or colleague, providing a score from 0 to 10. The replies are then categorized in 3 categories: 9-10 are promoters, 7-8 are passives and 0-6 are detractors. Afterwards the percentage of customers who are Detractors is subtracted from percentage of Promoters. This gives a score ranging from -100 (everybody is a Detractor) to +100 (everybody is a Promoter). A positive NPS is good, while an NPS of more than 50 is excellent.

  • Sean Ellis Test: for this score, users are asked how they would feel if they could no longer use the marketplace. The user can give 4 possible answers: very disappointed, somewhat disappointed, not disappointed or user already doesn’t use the marketplace. The score calculates the percentage of "very disappointed" answered compared to the total number of answers. A score of more than 40% gives an indication of product/market fit. A score below is an indication change is required to the marketplace.

Actively measuring all of the above metrics should give valuable insights on how to take the right decisions for growing out a successful marketplace.

Labels:

Comments

  1. pallavimaha18 April 2022 at 13:32

    Nice post. A marketplace software is a large online shopping center,where products from many brands are offered and in which you can find any product, anytime and from anywhere.

    ReplyDelete

Post a Comment

Popular posts from this blog

Transforming the insurance sector to an Open API Ecosystem

1. Introduction "Open" has recently become a new buzzword in the financial services industry, i.e.   open data, open APIs, Open Banking, Open Insurance …​, but what does this new buzzword really mean? "Open" refers to the capability of companies to expose their services to the outside world, so that   external partners or even competitors   can use these services to bring added value to their customers. This trend is made possible by the technological evolution of   open APIs (Application Programming Interfaces), which are the   digital ports making this communication possible. Together companies, interconnected through open APIs, form a true   API ecosystem , offering best-of-breed customer experience, by combining the digital services offered by multiple companies. In the   technology sector   this evolution has been ongoing for multiple years (think about the travelling sector, allowing you to book any hotel online). An excellent example of this
45 comments
Read more

Are product silos in a bank inevitable?

Silo thinking   is often frowned upon in the industry. It is often a synonym for bureaucratic processes and politics and in almost every article describing the threats of new innovative Fintech players on the banking industry, the strong bank product silos are put forward as one of the main blockages why incumbent banks are not able to (quickly) react to the changing customer expectations. Customers want solutions to their problems   and do not want to be bothered about the internal organisation of their bank. Most banks are however organized by product domain (daily banking, investments and lending) and by customer segmentation (retail banking, private banking, SMEs and corporates). This division is reflected both at business and IT side and almost automatically leads to the creation of silos. It is however difficult to reorganize a bank without creating new silos or introducing other types of issues and inefficiencies. An organization is never ideal and needs to take a number of cons
6 comments
Read more

RPA - The miracle solution for incumbent banks to bridge the automation gap with neo-banks?

Hypes and marketing buzz words are strongly present in the IT landscape. Often these are existing concepts, which have evolved technologically and are then renamed to a new term, as if it were a brand new technology or concept. If you want to understand and assess these new trends, it is important to   reduce the concepts to their essence and compare them with existing technologies , e.g. Integration (middleware) software   ensures that 2 separate applications or components can be integrated in an easy way. Of course, there is a huge evolution in the protocols, volumes of exchanged data, scalability, performance…​, but in essence the problem remains the same. Nonetheless, there have been multiple terms for integration software such as ETL, ESB, EAI, SOA, Service Mesh…​ Data storage software   ensures that data is stored in such a way that data is not lost and that there is some kind guaranteed consistency, maximum availability and scalability, easy retrieval and searching
26 comments
Read more

IoT - Revolution or Evolution in the Financial Services Industry

1. The IoT hype We have all heard about the   "Internet of Things" (IoT)   as this revolutionary new technology, which will radically change our lives. But is it really such a revolution and will it really have an impact on the Financial Services Industry? To refresh our memory, the Internet of Things (IoT) refers to any   object , which is able to   collect data and communicate and share this information (like condition, geolocation…​)   over the internet . This communication will often occur between 2 objects (i.e. not involving any human), which is often referred to as Machine-to-Machine (M2M) communication. Well known examples are home thermostats, home security systems, fitness and health monitors, wearables…​ This all seems futuristic, but   smartphones, tablets and smartwatches   can also be considered as IoT devices. More importantly, beside these futuristic visions of IoT, the smartphone will most likely continue to be the center of the connected devi
16 comments
Read more

Neobanks should find their niche to improve their profitability

The last 5 years dozens of so-called   neo- or challenger banks  (according to Exton Consulting 256 neobanks are in circulation today) have disrupted the banking landscape, by offering a fully digitized (cfr. "tech companies with a banking license"), very customer-centric, simple and fluent (e.g. possibility to become client and open an account in a few clicks) and low-cost product and service offering. While several of them are already valued at billions of euros (like Revolut, Monzo, Chime, N26, NuBank…​), very few of them are expected to be profitable in the coming years and even less are already profitable today (Accenture research shows that the average UK neobank loses $11 per user yearly). These challenger banks are typically confronted with increasing costs, while the margins generated per customer remain low (e.g. due to the offering of free products and services or above market-level saving account interest rates). While it’s obvious that disrupting the financial ma
7 comments
Read more

PFM, BFM, Financial Butler, Financial Cockpit, Account Aggregator…​ - Will the cumbersome administrative tasks on your financials finally be taken over by your financial institution?

1. Introduction Personal Financial Management   (PFM) refers to the software that helps users manage their money (budget, save and spend money). Therefore, it is often also called   Digital Money Management . In other words, PFM tools   help customers make sense of their money , i.e. they help customers follow, classify, remain informed and manage their Personal Finances. Personal Finance   used to be (or still is) a time-consuming effort , where people would manually input all their income and expenses in a self-developed spreadsheet, which would gradually be extended with additional calculations. Already for more than 20 years,   several software vendors aim to give a solution to this , by providing applications, websites and/or apps. These tools were never massively adopted, since they still required a lot of manual interventions (manual input of income and expense transaction, manual mapping transactions to categories…​) and lacked an integration in the day-to-da
5 comments
Read more

Can Augmented Reality make daily banking a more pleasant experience?

With the   increased competition in the financial services landscape (between banks/insurers, but also of new entrants like FinTechs and Telcos), customers are demanding and expecting a more innovative and fluent digital user experience. Unfortunately, most banks and insurers, with their product-oriented online and mobile platforms, are not known for their pleasant and fluent user experience. The   trend towards customer oriented services , like personal financial management (with functions like budget management, expense categorization, saving goals…​) and robo-advise, is already a big step in the right direction, but even then, managing financials is still considered to be a boring intangible and complex task for most people. Virtual (VR) and augmented reality (AR)   could bring a solution. These technologies provide a user experience which is   more intuitive, personalised and pleasant , as they introduce an element of   gamification   to the experience. Both VR and AR
9 comments
Read more

Beyond Imagination: The Rise and Evolution of Generative AI Tools

Generative AI   has revolutionized the way we create and interact with digital content. Since the launch of Dall-E in July 2022 and ChatGPT in November 2022, the field has seen unprecedented growth. This technology, initially popularized by OpenAI’s ChatGPT, has now been embraced by major tech players like Microsoft and Google, as well as a plethora of innovative startups. These advancements offer solutions for generating a diverse range of outputs including text, images, video, audio, and other media from simple prompts. The consumer now has a vast array of options based on their specific   output needs and use cases . From generic, large-scale, multi-modal models like OpenAI’s ChatGPT and Google’s Bard to specialized solutions tailored for specific use cases and sectors like finance and legal advice, the choices are vast and varied. For instance, in the financial sector, tools like BloombergGPT ( https://www.bloomberg.com/ ), FinGPT ( https://fin-gpt.org/ ), StockGPT ( https://www.as
2 comments
Read more

Eco-systems - Welcome to a new cooperating world

Last week I attended the Digital Finance Summit conference in Brussels, organized by Fintech Belgium, B-Hive, Febelfin and EBF. A central theme of the summit was the cooperation between banks and Fintechs and more in general the rise of ecosystems. In the past I have written already about this topic in my blogs about "Transforming the bank to an Open API Ecosystem ( https://www.linkedin.com/pulse/transforming-bank-open-api-ecosystem-joris-lochy/ ) and "The war for direct customer contact - Banks should fight along!" ( https://www.linkedin.com/pulse/war-direct-customer-contact-banks-should-fight-along-joris-lochy/ ), but still I was surprised about the number of initiatives taken in this domain. In my last job at The Glue, I already had the pleasure to work on several interesting cases: TOCO   ( https://www.toco.eu ): bringing entrepreneurs, accountants and banks closer together, by supporting entrepreneurs and accountants in their daily admin (and in the f
9 comments
Read more

From app to super-app to personal assistant

In July of this year,   KBC bank   (the 2nd largest bank in Belgium) surprised many people, including many of us working in the banking industry, with their announcement that they bought the rights to   broadcast the highlights of soccer matches   in Belgium via their mobile app (a service called "Goal alert"). The days following this announcement the news was filled with experts, some of them categorizing it as a brilliant move, others claiming that KBC should better focus on its core mission. Independent of whether it is a good or bad strategic decision (the future will tell), it is clearly part of a much larger strategy of KBC to   convert their banking app into a super-app (all-in-one app) . Today you can already buy mobility tickets and cinema tickets and use other third-party services (like Monizze, eBox, PayPal…​) within the KBC app. Furthermore, end of last year, KBC announced opening up their app also to non-customers allowing them to also use these third-party servi
9 comments
Read more