A Tesla Model X with the Full Self-Driving system active was involved in an accident in a residential area, highlighting the limitations of semi-autonomous driving and the role of the driver.
Former head of Uber's self-driving technology division, Raffi Krikorian, was involved in an accident in a Tesla Model X with the Full Self-Driving system enabled. The incident occurred while driving on residential streets: after a turn, the car suddenly jerked the steering wheel and crashed into a concrete wall. No one was injured.
Krikorian noted that the system had been working correctly for months, which built trust in the technology. However, the accident demonstrated the limitations of semi-autonomous systems. Despite the active assistance of electronics, responsibility remains with the driver.
The expert refers to the concept of a "moral crumple zone," proposed by researcher Madeleine Clare Elish. It describes a situation where, when a complex system fails, responsibility falls on the human, even if they were not directly controlling the process.
The effect of reduced attention is also emphasized. With prolonged control of an almost error-free system, the driver loses concentration. At the same time, it takes a person several seconds to restore reaction, which is critical in an emergency.
Similar features are characteristic of all systems with partial automation. Technologies take over most of the tasks but require immediate human intervention in a critical moment. According to the author, this stage of development is inevitable until the systems become fully autonomous.
Earlier, motoram.ru reported about a Tesla Cybertruck that also turned into a fence on its own.