Skip to main content

Cracking the Code of IT Project Delivery: Lessons from 20 Years in the Field


In August 2003, I started my professional career as an IT consultant at Accenture. This month marks my 20th work anniversary, a milestone that I celebrate with pride :-). Over these two decades, I have traversed the spectrum of IT project delivery, wearing various hats—developer, tester, business analyst, functional and technical analyst, all the way up to project management, test management, and solution architecture.

Yet, despite this experience, I remain consistently amazed at the challenges inherent in delivering IT projects on time, within budget, and meeting the expected quality. While software development is very rational, IT projects are very human and often irrational endeavors. While many managers stare blindly at objective metrics like development mandays or number of lines of code produced, it is essential to recognize that the development effort forms only a fraction of the entire project endeavor. Typically, the stumbling blocks in IT projects do not stem from development but rather from other facets.

How often have we not encountered projects for which the preparation phase takes months if not years, only to have the IT team being asked to implement the solution within a few months?

Once we realize and accept that IT projects cannot be nicely planned in a perfect Microsoft Project planning, because of their complexity, but even more because of all the human-factors involved in a project, we can better cope with it. Enter the philosophy of the Agile movement, i.e. advocating the continuous embracing of changes in vision, requirements and scope. Unfortunately, Agile consultants have taken over the movement by introducing all kinds of ceremonies and methodologies, which all aim to increase predictability. These slightly contradict the initial philosophy of the Agile movement. While some level of planning and forecasting remains necessary for budgeting resources, these should serve as guiding principles and not rigid as constraints.

Drawing from the successful IT project I have witnessed, several key practices stand out for effective IT project delivery:

  • Optimal Project Size: Strive for projects that are neither too small nor too large. Projects in the range of 300 to 600 man-days are in my opinion optimal, allowing for a dedicated team without overwhelming overhead.

  • Dedicated Team: A focused, dedicated team of a few individuals outperforms a larger team with fragmented commitments. This arrangement fosters accountability (everyone is accountable for the full delivery), teamwork, and focus (concentration).

  • Hands-On Pragmatism: Team members should embrace well-defined roles while remaining open to assisting with other tasks when needed. Clear alignment points (like e.g. daily stand-ups) and communication channels are important, but excessive ceremonies can be counterproductive (instead favor asynchronous alignment where possible).

  • Iterative Approach: Begin with a high-level vision, blueprint, and architecture and take sufficient time to define this well, then progressively refine the details through iterative cycles.

  • Short Feedback Loops: Maintain frequent communication between the product owner and developers throughout ticket design and testing phases. Too often, a ticket is put to "Blocked" and moved to the next sprint, because something is missing for a developer. Obviously, this should be avoided, as a good product owner should be able to rapidly complete anything missing in the ticket. Additionally it is highly productive if a developer asks an immediate quick validation from the product owner when he finished the story. This way most issues can immediately be identified and resolved, while everything is still fresh in the developer’s mind. Too often testing is only done at the end of the sprint, which means there is a delay of multiple days between the development and the validation of stories.

By adhering to these principles, you automatically end up with

  • Small, dedicated teams of 4-6 individuals encompassing roles such as a product owner, a lead developer, and additional developers.

  • Projects that are well-contained and independent (autonomous), lasting 4-6 months from initiation to delivery. This timeline includes 1-2 months for preparation and alignment on blueprints, followed by 3-5 months of execution. This means they should not be part of complex transformation programs, which bring too much overhead. Note that the fact that projects should not be part of larger programs does not mean the senior management should not have a clear medium to long term roadmap with several projects to execute in order to achieve a well-defined goal. The point I am making is that once a project is launched, it should work as autonomously as possible and only report on a 6-8 week basis to the Project Sponsor (e.g. in a Sponsor meeting or Steering Group).

  • A focus on tangible deliverables deployed in production. Once delivered the team should support during maximum 1-2 months (after-care). If they continue on a next iteration of the same product, they can continue the support. If not, there should be a clear hand-over to a support organization, so that the product team is liberated to focus on the next project.

  • A less strict application of Scrum methodology, as all the Scrum ceremonies create much overhead and reduce initiative, pragmatism and accountability. I am therefore a huge fan of working in Kanban style, with a prioritized back-log where everyone takes the story on top of the backlog. This approach does not mean you should not do a demo every 2 weeks, but it avoids this artificial pressure of fixing a number of stories in a sprint (while in reality there are always stories added or removed for particularly good reasons).

Balance these best practices with awareness of potential pitfalls, like

  • Foresee sufficient contingency: work is always underestimated and certain tasks are always missed. It is important to be aware of it and foresee sufficient contingency budget at any phase of the project. This budget should however only be used for unknown, missed and underestimated work and not for changes or for extra refactoring. In other words, stick to the scope, even if you still have contingency budget left. Most likely you will still use it later in the project. Usually (and unfortunately) the biggest surprises come near the end of the project when all the bits and pieces need to fit together.

  • Strive for simplicity over complexity and be aware of over-engineering, i.e.

    • Product managers love to create a lot of features and complex business rules to manage all the exceptions. Continuous challenging is therefore needed to ensure that all logic and all features are really needed and create sufficient value;

    • Developers like to re-engineer code (the code of another developer is almost always poorly written) and build technical frameworks from scratch (often reinventing the wheel). It is important the technical lead or solution architect challenges continuously the team to see if existing internal assets cannot be reused or open-source tooling or libraries are not available. It is also important to make code as modular as possible, so that re-engineering can be done gradually (i.e. when adapting a module as part of a change, do a refactoring of just that module). This gives as additional advantage, that code does not need to be perfect. If the underlying assumption is that the module will likely be rewritten in the foreseeable future, you can focus on the actual functionality of the module and on non-functional requirements, like performance, stability and security.

  • Remember the 80-20 rule: often the happy flow can be implemented quite quickly giving the feeling to the whole team that the finish is near. However implementing all the unhappy and exception scenarios is typically more work and always underestimated.

  • Automate as much as possible and never underestimate maintenance. A task that is supposed to be done only once, will likely have to be redone a few weeks later, so try to automate it as much as possible from the first time you do the task.
    This also applies to testing. I am a major fan of testing automation, as it can save an enormous amount of time, not having to redo the same tests manually each time and avoiding time-consuming fixes in production due to regressions. However, it is important to be pragmatic. I have seen many projects where enormous efforts are spent on writing unit tests for all code, while the code can be much easier tested (and easier automated), when testing on a higher functional level. These types of higher level automated functional tests are also easier to understand for the product owner and are less prone to continuous maintenance (when minor changes to the code are made).

Obviously as software projects are irrational, almost every member of a project team will have a different vision of what should be done or not done to deliver the project in the best conceivable way. The above guidelines are therefore just my personal vision. In a project, each team member will have unique insights into achieving optimal project delivery. It is therefore crucial to find a way of working in which everyone feels well in the project team and improve continuously. This will give the biggest buy-in and the highest motivation to work on the project. Ultimately, motivated and skilled teams will always find a way to get the job done.

Comments

Popular posts from this blog

Transforming the insurance sector to an Open API Ecosystem

1. Introduction "Open" has recently become a new buzzword in the financial services industry, i.e.   open data, open APIs, Open Banking, Open Insurance …​, but what does this new buzzword really mean? "Open" refers to the capability of companies to expose their services to the outside world, so that   external partners or even competitors   can use these services to bring added value to their customers. This trend is made possible by the technological evolution of   open APIs (Application Programming Interfaces), which are the   digital ports making this communication possible. Together companies, interconnected through open APIs, form a true   API ecosystem , offering best-of-breed customer experience, by combining the digital services offered by multiple companies. In the   technology sector   this evolution has been ongoing for multiple years (think about the travelling sector, allowing you to book any hotel online). An excelle...

Are product silos in a bank inevitable?

Silo thinking   is often frowned upon in the industry. It is often a synonym for bureaucratic processes and politics and in almost every article describing the threats of new innovative Fintech players on the banking industry, the strong bank product silos are put forward as one of the main blockages why incumbent banks are not able to (quickly) react to the changing customer expectations. Customers want solutions to their problems   and do not want to be bothered about the internal organisation of their bank. Most banks are however organized by product domain (daily banking, investments and lending) and by customer segmentation (retail banking, private banking, SMEs and corporates). This division is reflected both at business and IT side and almost automatically leads to the creation of silos. It is however difficult to reorganize a bank without creating new silos or introducing other types of issues and inefficiencies. An organization is never ideal and needs to take a numbe...

RPA - The miracle solution for incumbent banks to bridge the automation gap with neo-banks?

Hypes and marketing buzz words are strongly present in the IT landscape. Often these are existing concepts, which have evolved technologically and are then renamed to a new term, as if it were a brand new technology or concept. If you want to understand and assess these new trends, it is important to   reduce the concepts to their essence and compare them with existing technologies , e.g. Integration (middleware) software   ensures that 2 separate applications or components can be integrated in an easy way. Of course, there is a huge evolution in the protocols, volumes of exchanged data, scalability, performance…​, but in essence the problem remains the same. Nonetheless, there have been multiple terms for integration software such as ETL, ESB, EAI, SOA, Service Mesh…​ Data storage software   ensures that data is stored in such a way that data is not lost and that there is some kind guaranteed consistency, maximum availability and scalability, easy retrieval...

IoT - Revolution or Evolution in the Financial Services Industry

1. The IoT hype We have all heard about the   "Internet of Things" (IoT)   as this revolutionary new technology, which will radically change our lives. But is it really such a revolution and will it really have an impact on the Financial Services Industry? To refresh our memory, the Internet of Things (IoT) refers to any   object , which is able to   collect data and communicate and share this information (like condition, geolocation…​)   over the internet . This communication will often occur between 2 objects (i.e. not involving any human), which is often referred to as Machine-to-Machine (M2M) communication. Well known examples are home thermostats, home security systems, fitness and health monitors, wearables…​ This all seems futuristic, but   smartphones, tablets and smartwatches   can also be considered as IoT devices. More importantly, beside these futuristic visions of IoT, the smartphone will most likely continue to be the cent...

PSD3: The Next Phase in Europe’s Payment Services Regulation

With the successful rollout of PSD2, the European Union (EU) continues to advance innovation in the payments domain through the anticipated introduction of the   Payment Services Directive 3 (PSD3) . On June 28, 2023, the European Commission published a draft proposal for PSD3 and the   Payment Services Regulation (PSR) . The finalized versions of this directive and associated regulation are expected to be available by late 2024, although some predictions suggest a more likely timeline of Q2 or Q3 2025. Given that member states are typically granted an 18-month transition period, PSD3 is expected to come into effect sometime in 2026. Notably, the Commission has introduced a regulation (PSR) alongside the PSD3 directive, ensuring more harmonization across member states as regulations are immediately effective and do not require national implementation, unlike directives. PSD3 shares the same objectives as PSD2, i.e.   increasing competition in the payments landscape and en...

Trade-offs Are Inevitable in Software Delivery - Remember the CAP Theorem

In the world of financial services, the integrity of data systems is fundamentally reliant on   non-functional requirements (NFRs)   such as reliability and security. Despite their importance, NFRs often receive secondary consideration during project scoping, typically being reduced to a generic checklist aimed more at compliance than at genuine functionality. Regrettably, these initial NFRs are seldom met after delivery, which does not usually prevent deployment to production due to the vague and unrealistic nature of the original specifications. This common scenario results in significant end-user frustration as the system does not perform as expected, often being less stable or slower than anticipated. This situation underscores the need for   better education on how to articulate and define NFRs , i.e. demanding only what is truly necessary and feasible within the given budget. Early and transparent discussions can lead to system architecture being tailored more close...

Low- and No-code platforms - Will IT developers soon be out of a job?

“ The future of coding is no coding at all ” - Chris Wanstrath (CEO at GitHub). Mid May I posted a blog on RPA (Robotic Process Automation -   https://bankloch.blogspot.com/2020/05/rpa-miracle-solution-for-incumbent.html ) on how this technology, promises the world to companies. A very similar story is found with low- and no-code platforms, which also promise that business people, with limited to no knowledge of IT, can create complex business applications. These   platforms originate , just as RPA tools,   from the growing demand for IT developments , while IT cannot keep up with the available capacity. As a result, an enormous gap between IT teams and business demands is created, which is often filled by shadow-IT departments, which extend the IT workforce and create business tools in Excel, Access, WordPress…​ Unfortunately these tools built in shadow-IT departments arrive very soon at their limits, as they don’t support the required non-functional requirements (like h...

An overview of 1-year blogging

Last week I published my   60th post   on my blog called   Bankloch   (a reference to "Banking" and my family name). The past year, I have published a blog on a weekly basis, providing my humble personal vision on the topics of Fintech, IT software delivery and mobility. This blogging has mainly been a   personal enrichment , as it forced me to dive deep into a number of different topics, not only in researching for content, but also in trying to identify trends, innovations and patterns into these topics. Furthermore it allowed me to have several very interesting conversations and discussions with passionate colleagues in the financial industry and to get more insights into the wonderful world of blogging and more general of digital marketing, exploring subjects and tools like: Search Engine Optimization (SEO) LinkedIn post optimization Google Search Console Google AdWorks Google Blogger Thinker360 Finextra …​ Clearly it is   not easy to get the necessary ...

The UPI Phenomenon: From Zero to 10 Billion

If there is one Indian innovation that has grabbed   global headlines , it is undoubtedly the instant payment system   UPI (Unified Payments Interface) . In August 2023, monthly UPI transactions exceeded an astounding 10 billion, marking a remarkable milestone for India’s payments ecosystem. No wonder that UPI has not only revolutionized transactions in India but has also gained international recognition for its remarkable growth. Launched in 2016 by the   National Payments Corporation of India (NPCI)   in collaboration with 21 member banks, UPI quickly became popular among consumers and businesses. In just a few years, it achieved   remarkable milestones : By August 2023, UPI recorded an unprecedented   10.58 billion transactions , with an impressive 50% year-on-year growth. This volume represented approximately   190 billion euros . In July 2023, the UPI network connected   473 different banks . UPI is projected to achieve a staggering   1 ...

AI in Financial Services - A buzzword that is here to stay!

In a few of my most recent blogs I tried to   demystify some of the buzzwords   (like blockchain, Low- and No-Code platforms, RPA…​), which are commonly used in the financial services industry. These buzzwords often entail interesting innovations, but contrary to their promise, they are not silver bullets solving any problem. Another such buzzword is   AI   (or also referred to as Machine Learning, Deep Learning, Enforced Learning…​ - the difference between those terms put aside). Again this term is also seriously hyped, creating unrealistic expectations, but contrary to many other buzzwords, this is something I truly believe will have a much larger impact on the financial services industry than many other buzzwords. This opinion is backed by a study of McKinsey and PWC indicating that 72% of company leaders consider that AI will be the most competitive advantage of the future and that this technology will be the most disruptive force in the decades to come. Deep Lea...