While shaping the future of AI is crucial, the post-artificial general intelligence era is speculative and current AI development needs oversight and regulation to address present-day ethical concerns.