[HS]

Well this is where the awareness of uncertainty could help. Since it might be the wrong choice, and since you don't get to undo it, the threshold for suicide should be very high. I think our intuition for this answer comes from the awareness of our own ignorance.

Same reason we have the grace not to walk over gravestones, though it might be the shortest route and moral through sheer energy efficiency. An AI based only on concrete facts might stroll right through places like that, but we humans tend to consider the uncertainty.

[MikeB]

So apply more long term thinking to it, watch the uncertainty melt away...