Human-in-the-Loop Moral Decision-Making Frameworks for Situationally Aware Multi-Modal Autonomous Vehicle Networks: An Accessibility-Focused Approach

Authors

  • Vamsi Vemoori C&R Manager - ADAS/AD, Robert Bosch, Plymouth-MI, USA

Keywords:

Autonomous Vehicles, Connected Vehicles, Accessibility, Elderly, 5G Connectivity, Cybersecurity, Ethical Decision-Making, Human-Computer Interaction, Moral Decision-Making Framework

Abstract

The ethical implications of autonomous decision-making in AVs necessitate the development of robust frameworks that guide the vehicle's actions in unavoidable accident scenarios. These frameworks must consider not only the safety of the vehicle's occupants but also the potential impact on bystanders and the surrounding environment. Utilitarian ethics, which prioritize maximizing overall utility or well-being, often form the basis of such frameworks. However, this approach can be challenged in situations where difficult choices must be made, such as sacrificing the life of one passenger to save multiple pedestrians.

For instance, a utilitarian framework might dictate that an AV swerve to hit a single pedestrian rather than collide with a bus full of passengers. While this decision may maximize overall well-being by saving more lives, it raises concerns about the fairness of sacrificing one innocent person to save others. Additionally, utilitarian frameworks can be difficult to implement in practice, as they often rely on complex calculations of the potential consequences of various actions. These calculations can be fraught with uncertainty, particularly in situations with incomplete information or rapidly evolving circumstances.

Beyond the limitations of utilitarianism, other ethical frameworks also present challenges when applied to AV decision-making. Deontological ethics, which emphasizes following universal moral rules, can be inflexible in situations where adhering to a rule might lead to a worse outcome. For example, a deontological framework might dictate that an AV should always prioritize the safety of its occupants, regardless of the potential consequences for bystanders. This approach could result in the AV sacrificing the lives of pedestrians even when a swerving maneuver could avoid a collision altogether.

Virtue ethics, which focuses on developing good character traits, offers a less rigid framework but can be subjective and difficult to operationalize in the context of machine decision-making. How can we program an AV to embody virtues such as compassion, courage, and justice? These are complex questions that require ongoing philosophical and technological exploration.

To address these complexities, this paper proposes a moral decision-making framework for AVs that incorporates principles from various ethical schools of thought. The framework emphasizes the following core considerations:

  • Safety as the Paramount Principle: The primary objective of the AV's decision-making process should always be to minimize harm to human life. This principle aligns with the core tenets of most ethical frameworks and ensures that the safety of all individuals, including elderly and disabled passengers who may be more vulnerable in an accident, remains the top priority.
  • Transparency and Explainability: The decision-making process of the AV should be transparent and explainable to users. This can be achieved by developing algorithms that are not only effective but also interpretable, allowing users to understand the reasoning behind the AV's actions. For instance, the AV could provide an explanation of its decision-making process after a near-miss scenario, highlighting the factors it considered and the rationale behind its chosen course of action. This transparency can foster trust and acceptance among users, particularly those with pre-existing anxieties about relying on automated systems.
  • Respect for Human Values: The framework should incorporate respect for fundamental human values such as fairness, non-discrimination, and the sanctity of human life. This necessitates considering the potential impact of the AV's decisions on all individuals involved, including those with disabilities who may have different needs and vulnerabilities. For example, the framework should avoid prioritizing the survival of younger passengers over elderly passengers in an accident scenario.
  • Contextual Awareness: The framework should account for the specific context of the situation when making decisions. Factors such as weather conditions, traffic density, and the presence of vulnerable road users (e.g., pedestrians, cyclists, children) should all be factored into the AV's decision-making process. By considering the context, the AV can tailor its actions to minimize harm in a way that is sensitive to the specific circumstances.
  • Continuous Learning and Improvement: The ethical decision-making framework should be a living document that can evolve and adapt over time. As AV technology advances and real-world data is collected, the framework should be refined to address new ethical challenges and scenarios. This continuous learning process is crucial for maintaining public trust and ensuring the responsible development and deployment of AV technology.

Impact on Public Trust and Acceptance:

The ethical considerations outlined in this paper have a significant impact on public trust and acceptance of AV technology. By prioritizing safety, transparency, and respect for human values, AV developers can build public confidence in the ability of these vehicles to operate safely and ethically on our roads. This is particularly important for elderly and disabled individuals who may be more apprehensive about using a new transportation system. By ensuring that AVs are programmed to make decisions that align with human ethical intuitions, we can foster a future where AV technology empowers individuals of all abilities to live more independent and fulfilling lives.

References

C. Hu, J. Zhou, and S. Zhu, "Ethical Decision-Making for Autonomous Vehicles Using Machine Learning Techniques," IEEE Trans. Intell. Transp. Syst., vol. 21, no. 5, pp. 1914-1925, May 2020.

R. Yurtsever, N. Lambert, and C. K. Wong, "Autonomous Vehicles: A Human-Centered Approach to Decision Making," in Proc. IEEE ITSC, Auckland, New Zealand, Oct. 2019, pp. 3170-3176.

M. W. R. Nasir and M. Farooq, "A Comprehensive Review of Ethical Frameworks for Autonomous Vehicles," IEEE Access, vol. 8, pp. 89831-89845, 2020.

L. Chen et al., "Multi-Modal Perception for Autonomous Driving: Current Trends and Future Directions," IEEE Intell. Veh. Symp., Paris, France, Jun. 2019, pp. 323-330.

T. B. Sheridan, "Human-Autonomous Vehicle Interaction: A Framework for Human-Centered Design," IEEE Trans. Hum.-Mach. Syst., vol. 50, no. 4, pp. 325-334, Aug. 2020.

R. Arkin, "Ethical Decision Making in Autonomous Systems: A Case Study of Unmanned Systems," Proc. IEEE CASE, San Diego, CA, USA, Aug. 2019, pp. 167-174.

M. He et al., "Ethical AI in Autonomous Vehicles: A Human-Centered Approach," IEEE Trans. Intell. Veh., vol. 5, no. 3, pp. 424-435, Sep. 2020.

J. F. Bonnefon, A. Shariff, and I. Rahwan, "The Social Dilemma of Autonomous Vehicles," Science, vol. 352, no. 6293, pp. 1573-1576, Jun. 2016.

D. McCarthy et al., "Ethical Decision-Making Framework for Autonomous Vehicles," in Proc. IEEE ICMLA, Miami, FL, USA, Dec. 2019, pp. 329-334.

S. Rosique, C. J. Navarro, and A. Fernández, "A Survey of Perception Techniques for Autonomous Vehicles," IEEE Trans. Intell. Transp. Syst., vol. 20, no. 10, pp. 3782-3795, Oct. 2019.

K. Wada and T. Iwasaki, "Human-Machine Interaction in Autonomous Vehicles: Ethical Considerations," IEEE Trans. Veh. Technol., vol. 69, no. 6, pp. 6382-6392, Jun. 2020.

S. Müller et al., "Human-Centered Approaches for Ethical Autonomous Vehicles," in Proc. IEEE IV, Changshu, China, Jun. 2018, pp. 103-109.

A. Lin, "Ethical and Social Implications of Autonomous Vehicles," IEEE Trans. Syst., Man, Cybern. Syst., vol. 50, no. 6, pp. 4103-4111, Jun. 2020.

C. He, H. Liu, and H. Tang, "Human-in-the-Loop Learning for Autonomous Driving," in Proc. IEEE ITSC, Auckland, New Zealand, Oct. 2019, pp. 4230-4235.

M. Z. Winfield and J. Perez, "Autonomous Vehicles: Developing a Human-Centric Ethical Framework," IEEE Technol. Soc. Mag., vol. 39, no. 2, pp. 46-53, Jun. 2020.

N. Kalra and S. M. Paddock, "Driving to Safety: How Many Miles of Driving Would It Take to Demonstrate Autonomous Vehicle Reliability?," Transp. Res. Part A Policy Pract., vol. 94, pp. 182-193, Dec. 2016.

S. Bhargava and A. Mahajan, "Ethical Decision-Making in Self-Driving Cars: A Human-Centered Approach," in Proc. IEEE ICCI, Oxford, UK, Jun. 2019, pp. 423-429.

P. Lin, "Why Ethics Matters for Autonomous Cars," in Autonomes Fahren, M. Maurer et al., Eds. Berlin, Germany: Springer, 2015, pp. 69-85.

H. Winner and M. Lutz, "The Moral Algorithm: Ethical Decisions in Autonomous Driving," Automatisierungstechnik, vol. 67, no. 10, pp. 776-789, Oct. 2019.

L. Dennis et al., "Formal Verification of Ethical Choices in Autonomous Systems," Robot. Auton. Syst., vol. 77, pp. 1-14, Mar. 2016.

G. Contissa, F. Lagioia, and G. Sartor, "The Ethical Knob: Ethically-Customisable Automated Vehicles and the Law," Artif. Intell. Law, vol. 25, no. 3, pp. 365-378, Sep. 2017.

A. D. Howard and A. P. Wagner, "Ethical Considerations for Autonomous Vehicles," IEEE Robot. Autom. Mag., vol. 24, no. 4, pp. 96-107, Dec. 2017.

B. Kim et al., "Human-Centric AI for Autonomous Vehicles: Perspectives and Challenges," in Proc. IEEE HRI, Daegu, South Korea, Mar. 2019, pp. 583-591.

J. Robertson et al., "A Framework for Ethical Decision Making in Autonomous Vehicles," Ethics Inf. Technol., vol. 21, no. 2, pp. 183-196, Jun. 2019.

S. Wasson and C. H. Reynolds, "Ethical Implications of Autonomous Vehicle Deployment," IEEE Trans. Intell. Transp. Syst., vol. 21, no. 4, pp. 1736-1743, Apr. 2020.

S. Russell, "Human Compatible: AI and the Problem of Control," Penguin Random House, 2019.

N. B. Thomopoulos and M. Givoni, "The Autonomous Vehicle: Implications on Transport and Society," in Proc. IEEE VTS Conf., Innov. Veh. Netw. Technol., Stockholm, Sweden, Jun. 2019, pp. 1-6.

M. R. L. Bloomfield and R. J. Shapiro, "Autonomous Vehicles: Legal and Ethical Considerations," IEEE Technol. Soc. Mag., vol. 37, no. 4, pp. 25-34, Dec. 2018.

P. Lin, "Ethics of Autonomous Cars: A Brief Overview," IEEE Spectr., vol. 53, no. 6, pp. 22-28, Jun. 2016.

J. Ziegler et al., "Making Autonomous Vehicles a Reality: Lessons from the DARPA Urban Challenge," Proc. IEEE, vol. 103, no. 6, pp. 1061-1071, Jun. 2015.

Downloads

Published

10-02-2022

How to Cite

[1]
V. Vemoori, “Human-in-the-Loop Moral Decision-Making Frameworks for Situationally Aware Multi-Modal Autonomous Vehicle Networks: An Accessibility-Focused Approach”, J. Computational Intel. & Robotics, vol. 2, no. 1, pp. 54–87, Feb. 2022.