.Attribute Medicine, Published online: 26 July 2024 doi:10.1038/ s41591-024-03181-6Although big language designs (LLMs) reveal assurance in regulated settings, a study currently exposes their limits in real-world scientific requests as well as directs the method in the direction of robust assessment and benchmarking prior to professional use.