On 19th July 2024, the world witnessed one of the biggest IT disruptions in recent years, known as the “CrowdStrike Outage”. Many services and companies experienced substantial interruptions: A software update of the cyber security software CrowdStrike caused numerous Windows computers worldwide to crash with a fatal error reboot. Banking apps failed, thousands of flights were cancelled, electronic payment systems went offline, and hospitals had to cancel surgeries. The problem was so widespread that it has been declared one of the largest outages in history.
The widespread impact raises questions about how a single software update from a cybersecurity provider could disrupt such critical systems. This incident underscored the fragility of the world’s core infrastructure.
All of this raises some questions: How could a small bug in third-party software have such a significant impact on Microsoft’s operating system? Why are there no strict processes in place for when and how updates like this are deployed to customers?
Software development and maintenance should not merely be treated as cost factors
For SaaS (Software as a Service) companies, software development and maintenance are essentially cost factors they aim to minimise. However, focusing solely on minimising these costs is short-term thinking. Credible software companies typically adhere to proper development processes and best practices to prevent incidents:
Rigorous software testing: Thorough and methodical processes that ensure software functionality, reliability, and security meet or exceed expectations and requirements.
Canary releases: New software updates are rolled out to a small subset of users or servers to gather feedback and assess performance before a wider release.
Good observability: Effectively monitoring and understanding the internal state and behaviour of a system in real-time, facilitating quicker detection and resolution of issues.
Ability to roll back changes quickly: Allows returning to a previous software version swiftly if issues occur after an update, minimising disruption for users.
The situation at CrowdStrike remains unclear, leaving us with more questions than answers.
Recently, there has been a surge in new AI software startup companies aggressively competing for investment funds and striving to quickly establish themselves in the market. Their strategies often focus on aggressive market expansion, aiming to quickly acquire market share. While the surge in new AI software and innovation presents exciting opportunities, businesses should exercise caution when selecting software products.
Software startups often “move fast and break things”
In the dynamic world of early-stage software startup companies, Mark Zuckerberg’s mantra of “move fast and break things” often permeates the software development philosophy. This approach, while fostering rapid innovation and iteration, can sometimes result in hastily written code and an abundance of bugs.
Software startups are under pressure to deliver new features quickly and may prioritise speed over code quality, leading to shortcuts and technical debt accumulation. Consequently, the software may exhibit unexpected behaviours or encounter frequent bugs that require continuous debugging and maintenance.
Businesses must carefully select software solutions that meet their operational needs, especially those prioritising stability, security, and compliance with local laws and regulations. Established and credible software providers typically offer reliable products with robust support and regular updates. This reduces the risk of disruptions and ensures compatibility with existing systems, enhancing overall operational efficiency. Moreover, these providers are more likely to adhere to industry standards and regulatory requirements, minimising legal risks and ensuring businesses operate within legal frameworks.
Sound Business Systems is a discerning software distributor that meticulously selects the products we offer our clients. If you require expert guidance on transcription, speech-to-text, or document workflow software solutions, please don’t hesitate to contact us. We are committed to providing tailored solutions that meet your specific business needs and ensure optimal efficiency and performance.