Another View on Article 22 GDPR: The Future of Automated Decision-Making

Online First

Abstract

Artificial intelligence (AI) increasingly underpins automated decision-making (ADM) in high-stakes contexts such as credit scoring, workforce management, and public service allocation, raising acute concerns about transparency, accountability, and the limits of algorithmic secrecy. This paper examines how Article 22 GDPR should be understood following the Court of Justice of the European Union’s SCHUFA ruling, which resolved the prior doctrinal debate by confirming that Article 22(1) operates as a prohibition in principle, qualified by exceptions under Article 22(2) and safeguards under Article 22(3). Through doctrinal analysis of SCHUFA alongside EU national court and data protection authority decisions spanning multiple sectors, including Uber/Ola, Deliveroo/Foodinho, Buona Scuola, AMAS, Caixabank, and Grindr, the paper delineates operational criteria for when ADM is solely automated, when it reaches the significant effects threshold, and what meaningful information must substantively provide. The analysis demonstrates that intermediate algorithmic outputs can constitute ADM where they materially shape subsequent outcomes, and that nominal human review fails to satisfy Article 22 where it amounts to rubber-stamping without interpretive criteria or authority to deviate. The paper further develops a cumulative ADM doctrine: sequential or continuous automated steps may collectively trigger Article 22 where they produce aggregate effects on livelihood, credit, services, or public benefits. A key doctrinal contribution is the distinction between transactional non-selection, which does not cross the significance threshold, and positional assessment, where algorithmic flagging, downranking, or sanctioning alters an individual’s standing within a system and determines future access to opportunities. The paper concludes that explainable AI is a legally necessary instrument for making disclosures contestation-enabling under Article 22(3), but is insufficient without institutional safeguards, including genuine human oversight, rights to challenge, data protection impact assessments, and coordination with the AI Act’s risk-based framework.


Keywords:
Automated decision-making (ADM); Article 22 GDPR; Explainable AI (xAI); SCHUFA ruling; Algorithmic transparency; Algorithmic accountability

Pages:
1 – 32
References

[1] Addy, W. et al. (2024) AI in Credit Scoring: AComprehensive Review of Models and Predictive Analytics. Global Journal of Engineering and Technology Advances, 18 (2), pp. 118-129. Available from: https://doi.org/10.30574/gjeta.2 024.18.2.0029

[2] Almada, M. (2025) The EU AI Act: Logic, Content, and Implications for Finance. SSRN Electronic Journal. Available from: https://doi.org/10.2139/ssrn .5125735

[3] Article 29 Working Party. (2017) Guidelines on Automated Individual Decision-making and Profiling for the Purposes of Regulation 2016/679. WP251rev.01. Article 29 Working Party. Available from: https://ec.europa.eu/newsroom/article29/items/612053

[4] Aza, A. (2024) Scores as Decisions? Article 22 GDPR and the Judgment of the CJEU in SCHUFA Holding (Scoring) in the Labour Context. Industrial Law Journal, 53 (4), pp. 840-858. Available from: https://doi.org/10.1093/indlaw/d wae035

[5] Barredo Arrieta, A. et al. (2019) Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges Toward Responsible AI. Information Fusion, 58, pp. 82-115. Available from: https://doi.org/10.1016/j.inffus.2019.12.012

[6] Barros Vale, S. and Zanfir-Fortuna, G. (2022) Automated Decision-Making Under the GDPR: Practical Cases from Courts and Data Protection Authorities. Future of Privacy Forum (FPF). Available from: https://fpf.org/wpcontent/uploads/2022/05/FPF-ADM-Report-R2-singles.pdf

[7] Biber, D. S. E. (2023) Between Humans and Machines: Judicial Interpretation of the Automated Decision-Making Practices in the EU. SSRN Electronic Journal. Available from: https://doi.org/10.2139/ssrn.4662152 107 Rintamäki, T. et al. (2024) op. cit. pp. 25-26.

[8] Binns, R. and Veale, M. (2021) Is That Your Final Decision? Multi-stage Profiling, Selective Effects, and Article 22 of the GDPR. International Data Privacy Law, 11 (4), pp. 319-332. Available from: https://doi.org/10.1093/idpl/ipab020


[9] Brkan, M. (2019) Do Algorithms Rule the World? Algorithmic Decision-making and Data Protection in the Framework of the GDPR and Beyond. International Journal of Law and Information Technology, 27 (2), pp. 91-121. Available from:
https://doi.org/10.1093/ijlit/eay017

[10] Brkan, M. and Bonnet, G. (2020) Legal and Technical Feasibility of the GDPR’s Quest for Explanation of Algorithmic Decisions: of Black Boxes, White Boxes and Fata Morganas. European Journal of Risk Regulation, 11 (1), pp. 18-50. Available from: https://doi.org/10.1017/err.2020.10

[11] Bygrave, L. A. (2019) Minding the Machine v2.0: The EU General Data Protection Regulation and Automated Decision Making. SSRN Electronic Journal. Available from: https://doi.org/10.2139/ssrn.3329868

[12] Chopra, P. (2024) Ethical Implications of AI in Financial Services: Bias Transparency, and Accountability. International Journal of Scientific Research in Computer Science, Engineering and Information Technology, 10 (5), pp. 306-314. Available from: https://doi.org/10.32628/cseit241051017

[13] Clifford, D. and Ausloos, J. (2018) Data Protection and the Role of Fairness. Yearbook of European Law, 37, pp. 130-187. Available from: https://doi.org/10.1093/yel/yey004

[14] Davis, P. and Schwemer, S. F. (2023) Rethinking Decisions Under Article 22 of the GDPR: Implications for Semi-Automated Legal Decision-Making. SSRN Electronic Journal. Available from: https://doi.org/10.2139/ssrn.4478107

[15] Doshi-Velez, F. and Kim, B. (2017) Towards A Rigorous Science of Interpretable Machine Learning. ArXiv. Available from: https://doi.org/10.48550/arxiv.1702.08608

[16] Judgment of 7 December 2023, OQ v Land Hessen (SCHUFA Holding), C-634/21, ECLI:EU:C:2023:957.

[17] Judgment of 27 February 2025, Dun & Bradstreet Austria GmbH v GL, C-203/22, ECLI:EU:C:2025:117.

[18] Ebers, M. (2024) Truly Risk-based Regulation of Artificial Intelligence How to Implement the EU’s AI Act. European Journal of Risk Regulation, 16 (2), pp. 684-703. Available from: https://doi.org/10.1017/err.2024.78

[19] Edwards, L. and Veale, M. (2017) Slave to the Algorithm? Why a “Right to an Explanation” is Probably Not the Remedy You Are Looking for [preprint]. Available from: https://doi.org/10.31228/osf.io/97upg

[20] Ehsan, U. and Riedl, M. (2020) Human-centered Explainable AI: Towards a Reflective Sociotechnical Approach. ArXiv. Available from: https://doi.org/10.48550/arxiv.2002.01092

[21] Eiband, M. et al. (2018) Bringing Transparency Design into Practice. ACM Digital Library. pp. 211-223. Available from: https://doi.org/10.1145/3172944.3172961

[22] Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the Protection of Natural Persons with Regard to the Processing of Personal Data and on the Free Movement of Such Data, and Repealing Directive 95/46/EC. Official Journal of the European Union (L 119) 4 May. Available from: http://data.europa.eu/eli/reg/2016/679/oj

[23] Regulation (EU) 2022/2065 of the European Parliament and of the Council on a Single Market for Digital Services (Digital Services Act). Official Journal of the European Union (L 277) 19 October. Available from: http://data.europa.
eu/eli/reg/2022/2065/oj

[24] Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 Laying Down Harmonised Rules on Artificial Intelligence (AI Act). Official Journal of the European Union (OJ L 2024/1689) 12 July. Available from: http://data.europa.eu/eli/reg/2024/1689/oj

[25] Falletti, E. (2024) Credit Scoring Under Scrutiny by the Court of Justice of the European Union: Brief Remarks on the “SCHUFA Decision”. SSRN Electronic Journal. Available from: https://doi.org/10.2139/ssrn.4726282

[26] Felzmann, H. et al. (2019) Transparency You Can Trust: Transparency Requirements for Artificial Intelligence Between Legal Norms and Contextual Concerns. Big Data & Society, 6 (1), 205395171986054. Available from: https://doi.org/10.1177/2053951719860542

[27] Galetta, D.-U. and Pinotti, G. (2023) Automation and Algorithmic Decision-Making Systems in the Italian Public Administration. CERIDAP, 2023 (1), pp. 13-23. Available from: https://doi.org/10.13130/2723- 9195/2023-1-7

[28] Gerechtshof Amsterdam (No. 200.295.747/01) (2023). Available from: https://uitspraken.rechtspraak.nl/detailsid=ECLI:NL:GHAMS:2023:796

[29] Hamon, R. et al. (2022) Bridging the Gap Between AI and Explainability in the GDPR: Towards Trustworthiness-by-Design in Automated Decision-Making. IEEE Computational Intelligence Magazine, 17 (1), pp. 72-85. Available from: https://doi.org/10.1109/mci.2021.3129960

[30] Hubková, P. (2024) EU Administrative Decision-Making Delegated to Machines – Legal Challenges and Issues. AUC IURIDICA, 70 (2), pp. 101-119. Available from: https://doi.org/10.14712/23366478.2024.25

[31] Kaminski, M. (2019) The Right to Explanation, Explained. Berkeley Technology Law Journal, 34 (1). Available from: https://doi.org/10.15779/z38td9n83h

[32] Kaminski, M. E. and Malgieri, G. (2020) Algorithmic Impact Assessments Under the GDPR: Producing Multi-layered Explanations. International Data Privacy Law, 11 (2), pp. 125-144. Available from: https://doi.org/10.1093/idpl/ipaa020

[33] Karsai, K. (2021) Algorithmic Decisions within the Criminal Justice Ecosystem and Their Problem Matrix. International Review ofPenal Law /Revue Internationale de Droit Pénal, 92 (1), pp. 13-30.

[34] Karsai, K. (2024) The Use of Algorithms to Support Judicial Decision-Making in Criminal Matters with a Special Focus on Trial Decisions. Studia Iuridica Lublinensia, 33 (5), pp. 103-124. Available from: https://doi.org/10.17951/sil.2024.33.5.103-124

[35] Kłosok, M. and Chlebus, M. M. (2020) Towards Better Understanding of Complex Machine Learning Models Using Explainable Artificial Intelligence (XAI) – Case of Credit Scoring Modelling. In: Working Papers. Available from: https://ideas.repec.org/p/war/wpaper/2020-18.html [Accessed 28 March 2026]

[36] Lipton, Z. C. (2018) The Mythos of Model Interpretability. Communications ofthe ACM, 61 (10), pp. 36-43. Available from: https://doi.org/10.1145/3233231

[37] Lundberg, S. and Lee, S.-I. (2017) A Unified Approach to Interpreting Model Predictions. ArXiv. Available from: https://doi.org/10.48550/arxiv.1705.07874

[38] Mendoza, I. and Bygrave, L. A. (2017) The Right Not to be Subject to Automated Decisions Based on Profiling. Springer. pp. 77-98. Available from: https://do i.org/10.1007/978-3-319-64955-9_4

[39] Metikoš, L. and Ausloos, J. (2024) The Right to an Explanation in Practice: Insights from Case Law for the GDPR and the AI Act [preprint]. Available from: https://doi.org/10.31219/osf.io/ezgxf

[40] Miller, T. (2018) Explanation in Artificial Intelligence: Insights from the Social Sciences. Artificial Intelligence, 267, pp. 1 38. Available from: https://doi.org/10.1016/j.artint.2018.07.007

[41] Nannini, L. (2024) Habemus a Right to an Explanation: So What? – A Framework on Transparency-Explainability Functionality and Tensions in the EU AI Act. Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society, 7, pp. 1023-1035. Available from: https://doi.org/10.1609/aies.v7i1.31700

[42] Pasquale, F. (2015) The Black Box Society: The Secret Algorithms That Control Money and Information. Harvard University Press.

[43] Rechtbank Amsterdam (No. C/13/692003 / HA RK 20-302) (2021). Available from: https://uitspraken.rechtspraak.nl/details?id=ECLI:NL: RBAMS:2021:1018 [Accessed 28 March 2026]

[44] Rechtbank Amsterdam (No. C/13/689705 / HA RK 20-258) (2021). Available from: https://uitspraken.rechtspraak.nl/detailsid=ECLI:NL:RBAMS:2021:1019 [Accessed 28 March 2026]

[45] Ribeiro, M. T., Singh, S. and Guestrin, C. (2016) Why Should I Trust You?. KDD ’16: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. pp. 1135-1144. Available from: https://doi.org/10.1145/2939672.2939778

[46] Rintamäki, T. et al. (2024) Impact Assessment Requirements in the GDPR vs the AI Act: Overlaps, Divergence, and Implications [preprint]. Available from: https://doi.org/10.31219/osf.io/6qhzj

[47] Rudin, C. (2018) Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead. ArXiv. Available from: https://doi.org/10.48550/arxiv.1811.10154

[48] Rudolf, G. and Kováˇc, P. (2024) The Role of Automated Decision-Making in Modern Administrative Law: Challenges and Data Protection Implications. Central European Public Administration Review, 22 (2), pp. 83-108. Available from: https://doi.org/10.17573/cepar.2024.2.04

[49] Sarra, C. (2025) Artificial Intelligence in Decision-making: ATest of Consistency Between the “EU AI Act” and the “General Data Protection Regulation”. Athens Journal ofLaw, 11 (1), pp. 45-62. Available from: https://doi.org/10.30958/ajl.11-1-3

[50] Selbst, A. D. and Powles, J. (2017) Meaningful Information and the Right to Explanation. International Data Privacy Law, 7 (4), pp. 233-242. Available from: https://doi.org/10.1093/idpl/ipx022

[51] Silveira, A. (2023) Automated Individual Decision-making and Profiling [on Case C-634/21 – SCHUFA (Scoring)]. UNIO – EU Law Journal, 8 (2), pp. 74-85. Available from: https://doi.org/10.21814/unio.8.2.4842

[52] Smuha, N. A. (2021) From a “Race to AI” to a “Race to AI Regulation”: Regulatory Competition for Artificial Intelligence. Law, Innovation and Technology, 13 (1), pp. 57-84. Available from: https://doi.org/10.1080/17579961.2021.1898300

[53] Tamò-Larrieux, A. (2021) Decision-making by Machines: Is the “Law of Everything” Enough? Computer Law & Security Review, 41, 105541. Available from: https://doi.org/10.1016/j.clsr.2021.105541

[54] Thouvenin, F., Früh, A. and Henseler, S. (2022) Article 22 GDPR on Automated Individual Decision-Making: Prohibition or Data Subject Right? European Data Protection Law Review, 8 (2), pp. 183-198. Available from: https://doi.org/10.21552/edpl/2022/2/6

[55] Tosoni, L. (2021) The Right to Object to Automated Individual Decisions: Resolving the Ambiguity of Article 22(1) of the General Data Protection Regulation. International Data Privacy Law, 11 (2), pp. 145-162. Available from: https://doi.org/10.1093/idpl/ipaa024

[56] Tsakalakis, N. et al. (2024) A Typology ofExplanations for Explainability-by-Design [preprint]. Available from: https://doi.org/10.31235/osf.io/d3awg

[57] Van Kolfschooten, H. B. (2024) A Health-conformant Reading of the GDPR’s Right Not to be Subject to Automated Decision making. Medical Law Review, 32 (3), pp. 373-391. Available from: https://doi.org/10.1093/medlaw/fwae029

[58] Veale, M. and Borgesius, F. (2021) Demystifying the Draft EU Artificial Intelligence Act. Computer Law Review International (2021) 22(4) 97-112 Available from: https://doi.org/10.48550/arxiv.2107.03721

[59] Wachter, S., Mittelstadt, B. and Floridi, L. (2017) Why a Right to Explanation of Automated Decision-Making Does Not Exist in the General Data Protection Regulation. International Data Privacy Law, 7 (2), pp. 76-99. Available from: https://doi.org/10.1093/idpl/ipx00

[60] Wachter, S., Mittelstadt, B. and Russell, C. (2017) Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPR. ArXiv. Available from: https://doi.org/10.48550/arxiv.1711.00399

[61] Wang, Y. (2024) Ethical Considerations of AI in Financial Decision. Computing and Artificial Intelligence, 2 (1), 1290. Available from: https://doi.org/10.59400/cai.v2i1.1290

[62] Whittlestone, J. et al. (2019) The Role and Limits of Principles in AI Ethics: Towards a Focus on Tensions, AIES ’19: Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society. pp. 195-200. Available from: https://doi.org/10.1145/3306618.3314289

[63] Widagdo, P. et al. (2023) Artificial Intelligence in Credit Risk: A Literature Review. Proceeding of The International Seminar on Business, Economics, Social Science and Technology (ISBEST), 3 (1). Available from: https://doi.org/ 10.33830/isbest.v3i1.1472

Metrics

0

Crossref logo

0


0

Views

0

PDF views