|
「Can AI agents conduct open-ended AI research?」という論文は、AIエージェントが自律的にオープンエンドな研究を遂行できるかを検証した、プリンストン大学などの研究チームによる調査報告です。著者らは、未発表の高品質な論文の問いをAIに解かせ、その成果を原著者が査読する「シャドウ・エボリューション(影の評価)」という新たな評価手法を提唱しており、実験の結果、最新のAIは実験環境の構築といった高度なエンジニアリングには長けているものの、研究の核心である独創的な問いへの進展や論文としての質においては、専門家から「明確な拒絶」を受ける水準にとどまることが示されました。 AIによる研究の自動化には、現時点のモデルでは克服できない重大な限界があるとしています。 この論文を生成AIに深掘りさせましたので、ご参照ください。なお、生成AIによる調査・分析結果は、公開された情報だけに基づくものであり、必ずしも実情を示したものではなく、誤った情報を含む可能性があることにご留意のうえ、ご参照ください。 [Submitted on 29 Jul 2026 (v1), last revised 7 Aug 2026 (this version, v2)] Can AI agents conduct open-ended AI research? Early evidence from two case studies https://arxiv.org/abs/2607.27191 Current AI Agents Cannot Autonomously Conduct Open-Ended Research The paper “Can AI Agents Conduct Open-Ended AI Research?” reports on a study conducted by a research team from Princeton University and other institutions to examine whether AI agents can autonomously carry out open-ended research. The authors propose a new evaluation method called “shadow evaluation,” in which AI systems are tasked with addressing the research questions of high-quality, unpublished papers, and their results are then reviewed by the original authors. The experiments showed that although the latest AI systems are highly capable of performing sophisticated engineering tasks, such as setting up experimental environments, they remain unable to make meaningful progress on the original research questions at the heart of the studies or produce work of publishable quality. Expert reviewers judged the AI-generated research to be at a level warranting unequivocal rejection. The authors conclude that the automation of research using AI still faces fundamental limitations that cannot be overcome by current models. I asked generative AI to conduct an in-depth analysis of this paper, and I hope you will find the results informative. Please note, however, that the research and analysis generated by AI are based solely on publicly available information. They may not necessarily reflect the full reality of the subject and may contain errors. Your browser does not support viewing this document. Click here to download the document. Your browser does not support viewing this document. Click here to download the document. Your browser does not support viewing this document. Click here to download the document. Your browser does not support viewing this document. Click here to download the document. Your browser does not support viewing this document. Click here to download the document. Your browser does not support viewing this document. Click here to download the document. Your browser does not support viewing this document. Click here to download the document. Your browser does not support viewing this document. Click here to download the document. Your browser does not support viewing this document. Click here to download the document.
0 Comments
Leave a Reply. |
著者萬秀憲 アーカイブ
April 2026
カテゴリー |
RSS Feed