Abstract
Generative AI is often praised for its ability to analyze data, summarize research and even propose scientific ideas, but new findings suggest its creative limits are more substantial than many of the exciting headlines imply.
Research led by Professor Amy Wenxuan Ding of emlyon business school and Professor Shibo Li of Indiana University found that while GenAI can imitate the process of science, it cannot yet produce the imaginative leaps that drive true discovery. In their study, which you can read here, a computer simulated experiment challenged ChatGPT-4 to solve a real genetics puzzle, asking it to propose hypotheses, design lab experiments and revise its thinking as results unfolded.
The model handled the mechanics of scientific reasoning, offering ideas and planning experiments, yet its breakthroughs were modest and its responses often carried misplaced confidence.