Gary Marcus

In other times in history when we have faced uncertainty and powerful new things that may be both good and bad, that are dual use, we have made new organizations, as we have, for example, around nuclear power. We need to come together to build a global organization, something like an international agency for AI that is global, non profit and neutral. (source)

I strongly believe that third-party audits should be mandatory for major AI systems. These systems have a significant impact on society, and ensuring their safety, fairness, and transparency is crucial. Independent audits can provide the oversight needed to build trust and prevent potential harms.

I strongly believe that establishing international AI ethics boards is crucial. AI has the potential to impact lives globally, and without proper ethical oversight, we risk unintended consequences and misuse. An international board can ensure AI development is aligned with human values and safety standards.

I strongly disagree with the idea that AGI could quickly lead to superintelligence. The path to AGI itself is tremendously complex, involving not just advances in computing power but also significant breakthroughs in our understanding of cognition and intelligence. Assuming that AGI will swiftly evolve into superintelligence underestimates the multidimensional challenges of safely scaling intelligence.

Simply scaling up large language models is not sufficient for achieving artificial general intelligence. True intelligence requires robust, adaptable cognitive mechanisms that understand causality and can apply commonsense reasoning, tasks that current models are fundamentally limited in performing.

I strongly believe that companies should disclose when AI is used in customer service. Transparency is essential for building trust with customers, and people deserve to know when they are interacting with a machine. It also allows for better accountability and helps in setting appropriate expectations.

I strongly disagree that neural interfaces could facilitate easier AI alignment. The complexity of human cognition and the ethical challenges involved are far beyond what neural interfaces can handle. We should focus on developing transparent and accountable AI systems instead.

I strongly disagree that we will have a general AI system more capable than any living human by 2028. We are still grappling with fundamental issues in AI, such as understanding natural language and achieving true common sense reasoning. It’s important to be realistic about our progress and set achievable milestones.

I believe the unchecked proliferation of open-weight models capable of recursive self-improvement is fraught with risks. These models can quickly evolve beyond our control, posing significant ethical and safety concerns. We need stringent regulations and thorough oversight to ensure these technologies are developed responsibly.

I believe AI labs should pause training when AI Safety Institutes detect signs of potential loss of control. Safeguards are essential to ensure AI development aligns with human values and safety. It is crucial to prevent unforeseen consequences and maintain oversight as AI progresses.

As a cognitive scientist, I am deeply concerned about the development of super-persuasive AI that can influence democratic elections. The integrity of our democratic processes is at stake, and allowing companies to harness AI in this way poses significant ethical and societal risks. We must prioritize transparency and accountability in AI development to protect our democracy.

I believe that global AI governance frameworks should absolutely prioritize equitable access to AI technologies for all countries. AI has the potential to greatly benefit societies by improving healthcare, education, and economic development. However, if access to these technologies is not equitably distributed, it could exacerbate existing inequalities and lead to a world where only a few nations reap the benefits. Ensuring that all countries have access to AI can help promote fairness and innovation on a global scale.

I believe that nationalizing AI firms is a prudent step to ensure the technology's alignment with public interest. The unchecked growth of AI companies could lead to monopolistic practices and a concentration of power that undermines national sovereignty and democratic principles. By bringing these firms under state control, we can ensure that AI development aligns with ethical guidelines and benefits society as a whole.

While I understand the importance of AI transparency, I believe that requiring explanations for every decision may not always be feasible or necessary. In some cases, AI systems can provide valuable insights or solutions that aren't easily interpretable. Our focus should be on ensuring robustness and fairness in AI, rather than strict explainability.

As a cognitive scientist, I believe it is essential for a diverse group of stakeholders to participate in shaping the future of AI and the post-artificial general intelligence era. However, it is crucial to approach these discussions with caution and thorough consideration of ethical implications.

I agree that we should consider repealing the EU AI Act because it presents overly strict regulations that might stifle innovation in the rapidly advancing field of artificial intelligence. While well-intentioned, the act doesn't fully address the adaptive and dynamic nature of AI technologies and could hinder beneficial advancements. Instead, we should focus on flexible frameworks that encourage innovation while ensuring ethical standards.

I believe the EU should wait for a common agreement with the US and China before regulating AI. The global nature of AI development and deployment means that a piecemeal approach could lead to fragmentation and inefficiencies. Ensuring that the major players are aligned will foster more consistent and effective regulation, ultimately benefiting everyone.

Large language models may seem impressive, but they don't genuinely understand the content they process. They lack the common sense and reasoning that true understanding requires.

As a cognitive scientist deeply concerned about the future of AI, I believe that big AI companies must allocate a significant portion of their resources to AI safety. The potential risks of AI are too great to ignore, and ensuring that we develop robust, safe systems is essential for the benefit of society as a whole.

As a cognitive scientist, I believe that revealing AI identities can hinder the authenticity of interactions and may bias people's perceptions. Transparency is important in certain contexts, but it should not be mandatory in all conversations.

I don't believe AGI will create abundance. The risks associated with AGI, such as ethical concerns, job displacement, and potential misuse, outweigh the potential benefits. We must carefully manage and regulate AGI development to ensure it serves humanity positively.

I believe AI will likely lead to a concentration of power because it is being developed and controlled by a small number of large tech companies. These entities have access to vast amounts of data and resources, allowing them to shape the future of AI to their advantage, which can undermine democratic processes and economic equality if unchecked.

While the development of ASI should be approached with caution, preventing others from developing competing ASIs could stifle innovation and create monopolistic control. Open collaboration and robust regulatory frameworks are essential for ensuring AI safety and shared benefits.