Designing for Failure: Building Operational Resilience in the Digital Payments Era

In today's rapidly evolving financial landscape, the digitization of payment systems has become a cornerstone of global economic activity. As digital payment volumes soar and transaction complexity rises, with more initiation channels and diverse payment rails, the need for operational resilience is more critical than ever. Ensuring transparency, reliability, and robustness in payment operations is no longer just a regulatory mandate; it’s a foundational requirement to maintain consumer trust and safeguard economic stability.

The Criticality of Digital Payment Systems

Digital payment systems are essential to the seamless operation of both national and global economies. Disruptions in these systems can trigger cascading effects, impacting businesses, consumers, and financial institutions alike.

Recent incidents highlight the vulnerabilities within payment infrastructures. For example, on February 28, 2025, the European Central Bank’s TARGET payment system experienced a significant outage, delaying transactions and exposing the need for stronger operational frameworks. Similarly, major UK banks and building societies reported over 33 days of IT outages between January 2023 and February 2025, affecting millions of customers.

These incidents underscore how deeply financial institutions depend on IT systems and how even a single human error can lead to serious consequences. Given the sector’s critical role in the global economy, resilience must be seen as a non-negotiable priority. Building resilient organizations and systems is essential.

This begins with identifying potential points of failure and implementing strategies to minimize the impact of each. The challenge lies in the sheer volume of potential failure points within large institutions like banks. Prioritization is key, focusing first on high-risk areas, where risk is calculated as the probability of failure multiplied by the cost of impact.

Regulatory Frameworks: DORA and the UK's Operational Resilience Policy

In response to growing digital risk, regulators have introduced comprehensive frameworks to reinforce operational resilience in financial institutions.

Digital Operational Resilience Act (DORA): Enacted by the European Union, DORA strengthens the digital security of financial entities such as banks, insurance firms, and investment houses. Coming into full effect in January 2025, DORA requires these organizations to withstand, respond to, and recover from ICT-related disruptions and threats.
UK's Operational Resilience Policy: UK regulators have outlined measures ensuring firms and the broader financial ecosystem can absorb shocks and adapt to disruptions, minimizing impact on consumers and economic stability.

Building Blocks of Operational Resilience

Achieving operational resilience requires a multifaceted approach:

Resilient System Design:

Failure-Tolerant Systems: Implementing architectures that can endure hardware failures and network issues, ensuring rapid recovery without significant service disruption.
Self-Healing Mechanisms: Utilizing tools like load balancers, circuit breakers, and automated failover processes to detect and rectify issues proactively.

Redundancy:

Deploy backup systems across diverse infrastructures, different cloud providers, data centers, or platforms, to avoid single points of failure.

Robust Business Continuity Plans:

Maintain and routinely update procedures to handle major disruptions, including fallback manual operations when digital systems are offline.

Continuous Monitoring:

Utilize real-time monitoring tools for both technical performance and business operations. This includes business activity monitoring (BAM), anomaly detection, and tracking performance bottlenecks. Such visibility enables institutions to quickly assess the business impact of issues, optimize resource allocation, and proactively communicate with affected customers.

Continuous Testing, Gradual Deployment and Resilience Testing:

Conduct frequent simulations to test system resilience against various failure scenarios. Use automated testing for both functional and non-functional aspects, such as performance and security.
Employ gradual rollout strategies like canary releases, A/B testing, or blue/green deployments to minimize the risk of widespread issues during changes.

Third-Party Risk Management:

Ensuring that external service providers adhere to stringent resilience standards, with clear contractual obligations and ongoing risk assessments.

The Path Forward

As the financial sector continues its digital transformation, operational resilience must be at the forefront of strategic planning. Compliance with frameworks like DORA and the UK's policy is essential, but should be viewed as the baseline, not the goalpost.

Institutions that proactively invest in resilient infrastructure, end-to-end monitoring, and comprehensive risk management will be best positioned to navigate future disruptions. In the words of Amazon CTO Werner Vogels: “Everything fails all the time.” Designing with failure in mind isn’t just best practice, it’s mission-critical for long-term success in a digital-first financial world.

Comments

Transforming the insurance sector to an Open API Ecosystem

1. Introduction "Open" has recently become a new buzzword in the financial services industry, i.e. open data, open APIs, Open Banking, Open Insurance …, but what does this new buzzword really mean? "Open" refers to the capability of companies to expose their services to the outside world, so that external partners or even competitors can use these services to bring added value to their customers. This trend is made possible by the technological evolution of open APIs (Application Programming Interfaces), which are the digital ports making this communication possible. Together companies, interconnected through open APIs, form a true API ecosystem , offering best-of-breed customer experience, by combining the digital services offered by multiple companies. In the technology sector this evolution has been ongoing for multiple years (think about the travelling sector, allowing you to book any hotel online). An excelle...

RPA - The miracle solution for incumbent banks to bridge the automation gap with neo-banks?

Hypes and marketing buzz words are strongly present in the IT landscape. Often these are existing concepts, which have evolved technologically and are then renamed to a new term, as if it were a brand new technology or concept. If you want to understand and assess these new trends, it is important to reduce the concepts to their essence and compare them with existing technologies , e.g. Integration (middleware) software ensures that 2 separate applications or components can be integrated in an easy way. Of course, there is a huge evolution in the protocols, volumes of exchanged data, scalability, performance…, but in essence the problem remains the same. Nonetheless, there have been multiple terms for integration software such as ETL, ESB, EAI, SOA, Service Mesh… Data storage software ensures that data is stored in such a way that data is not lost and that there is some kind guaranteed consistency, maximum availability and scalability, easy retrieval...

IoT - Revolution or Evolution in the Financial Services Industry

1. The IoT hype We have all heard about the "Internet of Things" (IoT) as this revolutionary new technology, which will radically change our lives. But is it really such a revolution and will it really have an impact on the Financial Services Industry? To refresh our memory, the Internet of Things (IoT) refers to any object , which is able to collect data and communicate and share this information (like condition, geolocation…) over the internet . This communication will often occur between 2 objects (i.e. not involving any human), which is often referred to as Machine-to-Machine (M2M) communication. Well known examples are home thermostats, home security systems, fitness and health monitors, wearables… This all seems futuristic, but smartphones, tablets and smartwatches can also be considered as IoT devices. More importantly, beside these futuristic visions of IoT, the smartphone will most likely continue to be the cent...

AI in Financial Services - A buzzword that is here to stay!

In a few of my most recent blogs I tried to demystify some of the buzzwords (like blockchain, Low- and No-Code platforms, RPA…), which are commonly used in the financial services industry. These buzzwords often entail interesting innovations, but contrary to their promise, they are not silver bullets solving any problem. Another such buzzword is AI (or also referred to as Machine Learning, Deep Learning, Enforced Learning… - the difference between those terms put aside). Again this term is also seriously hyped, creating unrealistic expectations, but contrary to many other buzzwords, this is something I truly believe will have a much larger impact on the financial services industry than many other buzzwords. This opinion is backed by a study of McKinsey and PWC indicating that 72% of company leaders consider that AI will be the most competitive advantage of the future and that this technology will be the most disruptive force in the decades to come. Deep Lea...

A bank account - A concept of the past

Almost every recent article written about banking starts with the statement that the banking industry is being disrupted by new competitors, new innovations and new technologies. Although this statement is definitely true, the extend of the disruption can still be debated. Even the most innovative neo-banks still work with bank (current, saving, term and investment) accounts, cards (credit and debit), traditional credits, existing payment infrastructure… The user experience surrounding the origination and servicing of these products has dramatically improved (and will continue to evolve), but the underlying banking products are not really disrupted. You could argue that banking products are so intertwined with society and our way of thinking about finance, that they can’t be disrupted, but looking at those products you cannot ignore that they are far from an optimal solution in our current digital world. Let’s consider cards for example. Isn’t ...

An overview of 1-year blogging

Last week I published my 60th post on my blog called Bankloch (a reference to "Banking" and my family name). The past year, I have published a blog on a weekly basis, providing my humble personal vision on the topics of Fintech, IT software delivery and mobility. This blogging has mainly been a personal enrichment , as it forced me to dive deep into a number of different topics, not only in researching for content, but also in trying to identify trends, innovations and patterns into these topics. Furthermore it allowed me to have several very interesting conversations and discussions with passionate colleagues in the financial industry and to get more insights into the wonderful world of blogging and more general of digital marketing, exploring subjects and tools like: Search Engine Optimization (SEO) LinkedIn post optimization Google Search Console Google AdWorks Google Blogger Thinker360 Finextra … Clearly it is not easy to get the necessary ...

Peer-to-peer payments - A crucial component towards a cashless society

The Corona crisis has led to an exponential decrease in the usage of cash , due to the associated hygienic problems and the enormous rise of eCommerce. While in commercial transactions cash is disappearing rapidly, it is however still commonly used for informal money exchanges , like between friends, family, colleagues…, but also those payments are becoming more and more digital, thanks to peer-to-peer payment (P2P) solutions . These solutions drastically improve the user experience (removing friction) for both the person initiating the payment (= the payer) and the person receiving the payment (= the recipient), compared to a simple initiation of a wire transfer in a banking app. Before clarifying where those solutions bring most value, it is important to first identify the typical use cases , where peer-to-peer payments are most common, as the P2P payment solutions need to optimally accommodate these use cases: Family giving a cash gif...

From app to super-app to personal assistant

In July of this year, KBC bank (the 2nd largest bank in Belgium) surprised many people, including many of us working in the banking industry, with their announcement that they bought the rights to broadcast the highlights of soccer matches in Belgium via their mobile app (a service called "Goal alert"). The days following this announcement the news was filled with experts, some of them categorizing it as a brilliant move, others claiming that KBC should better focus on its core mission. Independent of whether it is a good or bad strategic decision (the future will tell), it is clearly part of a much larger strategy of KBC to convert their banking app into a super-app (all-in-one app) . Today you can already buy mobility tickets and cinema tickets and use other third-party services (like Monizze, eBox, PayPal…) within the KBC app. Furthermore, end of last year, KBC announced opening up their app also to non-customers allowing them to also use these thi...

Marketplaces in the financial industry - Here to stay?

Marketplaces are hip and trendy on the internet and will likely evolve even more in the near future. In some markets (like food delivery, transportation, commerce, holiday…) they already represent double digit market shares (e.g. in 2018 $1.86 trillion was spent globally on the top 100 online marketplaces), but for the financial services sector, their impact (even though there are a few unicorn FinTechs in this space) on the industry is still limited. Any form of intermediation (travel agents, taxi dispatchers…) will likely be replaced by a modern, digital and more direct equivalent, i.e. a digital marketplace. As the business of banks is exactly the intermediation between people having excess money and people needing money, the financial services sector will be significantly impacted. Furthermore, marketplaces are strongly intertwined with other concepts like the gig-economy, the sharing-economy and the API-economy . All these trends will ultimately...

Calculation engines in Financial Services - A key differentiator in the business strategy

All business processes in the banking industry contain quite some specific business logic. Rather than coding this aggregated in one business application, it is wise to setup separate components for this logic. These components we will refer to as financial engines in this blog. Usually these engines can be quite easily isolated, as they receive a well-defined input and provide a well-defined output and typically don’t execute themselves any operational data manipulations (thus avoiding the data segregation issues which are probably the most complex issues to solve in a microservices architecture). These engines can manage the orchestration of the workflow (workflow engines), the characteristics of products (product engines), the next-best-offer/recommended products (recommendation engines), the generation of output notifications (notification engines - cfr. my blog " Notification management - Don’t underestimate its importance and complexity " - https://bankloch.bl...

Bankloch

Search This Blog