Courts Must Adapt to Hold Algorithmic Decision-Making Systems Accountable
Source: https://www.theguardian.com/profile/kronbland-charlotta. "I took an algorithm to court in Sweden. The algorithm won | Charlotta Kronblad | The Guardian." April 30, 2026. www.theguardian.com
The Gist
When government computer programs make unfair decisions affecting many people, our courts can't properly investigate because they can't see how the programs work. We need to change the legal system so that the government has to prove their computer programs are fair, rather than forcing citizens to prove they're unfair without being able to see the code.
Conclusion
Legal systems must be reformed to effectively scrutinize algorithmic decision-making by shifting the burden of proof to system deployers and creating procedures for systematic redress
Premises
- Algorithmic failures in public systems create cascading injustices that cannot be addressed through individual appeals alone
- Current legal procedures place an impossible burden of proof on citizens to demonstrate algorithmic malfunctions without access to the underlying code
- Courts currently defer to technology rather than interrogating it, allowing systemic injustices to persist for years
- Multiple scandals across Europe (Gothenburg schools, UK Post Office, Dutch childcare benefits) demonstrate a pattern of algorithmic injustice enabled by inadequate legal oversight
- Public authorities deploy opaque algorithmic systems at scale while citizens face life-altering consequences with no meaningful recourse
- The technical complexity of algorithms creates a 'black box' problem that existing legal frameworks cannot penetrate
Assumptions
- Algorithmic decision-making systems will continue to be widely used in public administration
- Courts have the potential capacity to effectively scrutinize algorithmic systems if given proper tools and procedures
- Systematic redress is more appropriate than individual appeals for addressing algorithmic failures
- Those who deploy algorithmic systems should bear responsibility for proving their legality and fairness