Ethical Risks of Artificial Intelligence in Health Systems
Keywords:
Artificial intelligence, health, healthcare ethics, ethical theory, beneficence, non-maleficence, patient autonomy.Abstract
AI holds the potential to transform healthcare delivery by improving decision-making and operational efficiency. However, it is important to address the ethical, governance, and operational issues associated with AI-enabled applications before they can be safely and effectively deployed. AI-enabled healthcare presents unique challenges for beneficence, non-maleficence, and patient autonomy. The AI development lifecycle is often not under the control of healthcare institutions, nor are the outputs of AI systems properly understood. Consequently, the true impact of AI on patient outcomes, equity, and justice cannot be adequately evaluated.
Governance frameworks play an essential role in establishing an initial level of assurance. A well-conceived but imperfectly implemented implementation governance framework can help reduce harm and increase public trust. IRBs, in combination with government-sponsored risk management and safety assurance measures, can address most of the requirements of the Safe and Effective Product Regulations. These agencies are best placed to prevent harm emanating from the use of AI-enabled interventions. The next operational development steps focus on building the evidence needed to inform and guide healthcare AI. Proactive information sharing, together with proper documentation and knowledge capes, can mitigate some of the consequences of working without feedback or clinical validation.
References
1. Dalton-Brown, S. (2020). The ethics of medical AI and the physician-patient relationship. Cambridge Quarterly of Healthcare Ethics, 29(1), 115–121.
2. Morley, J., Machado, C. C. V., Burr, C., Cowls, J., Joshi, I., Taddeo, M., & Floridi, L. (2020). The ethics of AI in health care: A mapping review. Social Science & Medicine, 260, 113172.
3. Amann, J., Blasimme, A., Vayena, E., Frey, D., Madai, V. I., & Precise4Q Consortium. (2020). Explainability for artificial intelligence in healthcare: A multidisciplinary perspective. BMC Medical Informatics and Decision Making, 20, 310.
4. Paleti, S., Baliyan, M., Aitha, A. R., Reddy, B. A., Bhadauria, G. S., & Sing, S. A. (2025, August). Graph—LSTM Hybrid Model for Improving Fraud Detection Accuracy in E-Commerce Financial Services. In 2025 2nd International Conference on Intelligent Algorithms for Computational Intelligence Systems (IACIS) (pp. 1-6). IEEE.
5. Kerasidou, A. (2021). Ethics of artificial intelligence in global health: Explainability, algorithmic bias and trust. Journal of Oral Biology and Craniofacial Research, 11(4), 612–614.
6. Ghassemi, M., Oakden-Rayner, L., & Beam, A. L. (2021). The false hope of current approaches to explainable artificial intelligence in health care. The Lancet Digital Health, 3(11), e745–e750.
7. Seyyed-Kalantari, L., Zhang, H., McDermott, M. B. A., Chen, I. Y., & Ghassemi, M. (2021). Underdiagnosis bias of artificial intelligence algorithms applied to chest radiographs in under-served patient populations. Nature Medicine, 27, 2176–2182.
8. Karimian, G., Petelos, E., & Evers, S. M. A. A. (2022). The ethical issues of the application of artificial intelligence in healthcare: A systematic scoping review. AI and Ethics, 2, 539–551.
9. Meda, R. (2025). Dynamic Territory Management and Account Segmentation using Machine Learning: Strategies for Maximizing Sales Efficiency in a US Zonal Network. EKSPLORIUM-BULETIN PUSAT TEKNOLOGI BAHAN GALIAN NUKLIR, 46(1), 634-653.
10. Rajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022). AI in health and medicine. Nature Medicine, 28, 31–38.
11. Kempt, H., Heilinger, J.-C., & Nagel, S. K. (2022). Relative explainability and double standards in medical decision-making. Ethics and Information Technology, 24, 20.
12. Rueda, J., et al. (2022). “Just” accuracy? Procedural fairness demands explainability in AI-based medical resource allocations. AI and Ethics, 2, 1–10.
13. Naik, N., Hameed, B. M. Z., Shetty, D. K., Swain, D., Shah, M., Paul, R., Aggarwal, K., Ibrahim, S., Patil, V., Smriti, K., Shetty, S., Rai, B. P., Chlosta, P., & Somani, B. K. (2022). Legal and ethical consideration in artificial intelligence in healthcare: Who takes responsibility? Frontiers in Surgery, 9, 862322.
14. Timmons, A. C., Duong, J. B., Simo Fiallo, N., Lee, T., Vo, H. P. Q., Ahle, M. W., Comer, J. S., et al. (2023). A call to action on assessing and mitigating bias in artificial intelligence applications for mental health. Perspectives on Psychological Science, 18(5), 1062–1096.
15. Kalisetty, S., & Inala, R. (2025). Designing Scalable Data Product Architectures With Agentic AI And ML: A Cross-Industry Study Of Cloud-Enabled Intelligence In Supply Chain, Insurance, Retail, Manufacturing, And Financial Services. Metallurgical and Materials Engineering, 86-98.
16. Wang, C., Liu, S., Yang, H., Guo, J., Wu, Y., & Liu, J. (2023). Ethical considerations of using ChatGPT in health care. Journal of Medical Internet Research, 25, e48009.
17. Benzinger, L., Ursin, F., Balke, W.-T., Kacprowski, T., & Salloch, S. (2023). Should artificial intelligence be used to support clinical ethical decision-making? A systematic review of reasons. BMC Medical Ethics, 24, 48.
18. Albahri, A. S., Duhaim, A. M., Fadhel, M. A., Alnoor, A., Baqer, N. S., Alzubaidi, L., Albahri, O. S., Alamoodi, A. H., Bai, J., Salhi, A., Santamaría, J., Ouyang, C., Gupta, A., Gu, Y., & Deveci, M. (2023). A systematic review of trustworthy and explainable artificial intelligence in healthcare: Assessment of quality, bias risk, and data fusion. Information Fusion, 96, 156–191.
19. Al-Hwsali, A., Alsaadi, B., Abdi, N., Khatab, S., Alzubaidi, M., Solaiman, B., & Househ, M. (2023). Scoping review: Legal and ethical principles of artificial intelligence in public health. Studies in Health Technology and Informatics, 305, 640–643.
20. Lebcir, I., Mageswari, S. D., Bhosale, Y. H., Nagubandi, A. R., & Mahabooba, M. (2025). Agile Strategic Management in the Age of Disruption: Leveraging AI and Data Analytics for Competitive Advantage. Advances in Consumer Research, 2(6), 2581.
21. Ning, Y., Teixayavong, S., Shang, Y., Savulescu, J., Nagaraj, V., Miao, D., Mertens, M., Ting, D. S. W., Ong, J. C. L., Liu, M., Cao, J., Dunn, M., Vaughan, R., Ong, M. E. H., Sung, J. J.-Y., Topol, E. J., & Liu, N. (2024). Generative artificial intelligence and ethical considerations in health care: A scoping review and ethics checklist. The Lancet Digital Health, 6(11), e848–e856.
22. Mennella, C., Maniscalco, U., De Pietro, G., & Esposito, M. (2024). Ethical and regulatory challenges of AI technologies in healthcare: A narrative review. Heliyon, 10(4), e26297.
23. Hansson, S. O., & Fröding, B. (2024). Digital technology in healthcare—An ethical overview. Digital Society, 3, 46.
24. Hofweber, T., & Walker, R. L. (2024). Machine learning in health care: Ethical considerations tied to privacy, interpretability, and bias. North Carolina Medical Journal, 85(4), 240–245.
25. Meda, R. (2025). AI-Driven Demand and Supply Forecasting Models for Enhanced Sales Performance Management: A Case Study of a Four-Zone Structure in the United States. Metallurgical and Materials Engineering, 1480-1500.
26. Vandemeulebroucke, T. (2024). The ethics of artificial intelligence systems in healthcare and medicine: From a local to a global perspective, and back. Pflügers Archiv—European Journal of Physiology, 477(4), 591–601.
27. Rony, M. K. K., Numan, S. M., Akter, K., Tushar, H., Debnath, M., Johra, F. T., Akter, F., Mondal, S., Das, M., Uddin, M. J., Begum, J., & Parvin, M. R. (2024). Nurses’ perspectives on privacy and ethical concerns regarding artificial intelligence adoption in healthcare. Heliyon, 10(17), e36702.
28. Inglada Galiana, L., Corral Gudino, L., & Miramontes González, P. (2024). Ethics and artificial intelligence. Revista Clínica Española, 224(3), 178–186.
29. Savulescu, J., Giubilini, A., Vandersluis, R., & Mishra, A. (2024). Ethics of artificial intelligence in medicine. Singapore Medical Journal, 65(3), 150–158.
30. Kumar, K. M., Parasar, A., Walia, A., Inala, R., & Thulasimani, T. (2025, August). Enhancing Risk Management Strategies in Financial Institutions Using CNN and Support Vector Regression. In 2025 5th Asian Conference on Innovation in Technology (ASIANCON) (pp. 1-6). IEEE.
31. Khan, M. M., Shah, N., Shaikh, N., Thabet, A., Alrabayah, T., & Belkhair, S. (2025). Towards secure and trusted AI in healthcare: A systematic review of emerging innovations and ethical challenges. International Journal of Medical Informatics, 195, 105780.
32. Moulaei, K., Akhlaghpour, S., & Fatehi, F. (2025). Patient consent for the secondary use of health data in artificial intelligence (AI) models: A scoping review. International Journal of Medical Informatics, 198, 105872.
33. Montalbano, P. (2025). Ethical and legal considerations of medical artificial intelligence. Primary Care, 52(4), 769–779.
34. Korukoglu, F. B., Rishan, R. M., Elhamer, Z., Lakamana, S., Zhang, J., & Bozkurt, S. (2025). Mapping ethical guidelines for AI in healthcare: A global perspective. Studies in Health Technology and Informatics, 327, 1358–1362.
35. Badawy, W., Zinhom, H., & Shaban, M. (2025). Navigating ethical considerations in the use of artificial intelligence for patient care: A systematic review. International Nursing Review, 72, e13059.
36. Ning, Y., Liu, M., & Liu, N. (2025). Advancing ethical AI in healthcare through interpretability. Patterns, 6(6), 101290.
Additional Files
Published
Data Availability Statement
None
Issue
Section
License
Copyright (c) 2026 Christopher Wilson (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
This work is licensed under the Creative Commons Attribution 4.0 International License (CC BY 4.0). Authors retain full copyright of their published work. Under this license, others are free to share, copy, distribute, transmit, remix, transform, and build upon the published work for any purpose, including commercial use, provided that appropriate credit is given to the original authors, a link to the license is provided, and any changes made are clearly indicated. No additional restrictions may be applied that limit others from doing anything the license permits. All published articles are freely and permanently accessible online to readers worldwide without any subscription or access fees.
License URL: https://creativecommons.org/licenses/by/4.0/
