@facw
with the right training
The thing is, every scenario can not be trained for.
I'm sure that the software will one day be good enough for 99% of cases, but there will always be edge cases in which the computer will be left "confused" and helpless.
Consider a family fleeing a wildfire. Their car may come to a place where there are fairly large branches over the road, and the only choice is to ram through them, potentially damaging the car, in order to get through to safety.
Consider a family surrounded by violent assailants, where the car actually needs to push through people to get free to safety.
Consider a family trying to get the the emergency room to save their child. They encounter a place where the only choice is to drive on the wrong side of the road, and perhaps to even sideswipe another vehicle.
There's no way the software would allow for any of this.
Obviously, these are cases where only 1% of 1% would experience them, but they do exist, and could be deadly for the occupants if the software is in full control.
I totally agree that on the balance, the computers/software will be safer and fewer people will die in accidents, but if you're the family in the situation where you're in danger because of the software not making the necessary decision, all that doesn't matter.