As a physician and bioethicist, I believe that AI systems should not be allowed to make important medical decisions. While AI can aid in diagnostics and treatment plans, the complexity of human health requires the nuanced judgment and ethical considerations that only trained medical professionals can provide.