Can AI read papers like a scientist? A new benchmark shows where LLMs fail

To stay up to date and work forward in their fields, scientists must have at their fingertips and in their minds thousands of published studies. Large language models (LLMs) show promise as a tool for exploring the vast scientific literature, but are they trustworthy when it comes to providing full and scientifically accurate answers to complex questions in specialized fields?


play_arrow All United States of America News
3 h.
Science
ID: -110110499901324438


Similar News expand_more


1 M. Is artificial general intelligence already here? A new case that today's LLMs meet key tests
Technology
4 w. In the aftermath of WW2, why did FDR’s Latin American experiment end in abject failure?
Science
1 M. AI is failing 'Humanity's Last Exam'—so what does that mean for machine intelligence?
Science
1 M. No evidence to support US claim China conducted nuclear blast test: Monitor
Technology
2 w. How can you avoid AI sycophancy? Keep it professional, researchers say
Science
2 w. Researchers develop a system that detects subtle defects missed by existing industrial visual inspection
Science
2 w. Washington troopers' DUI crackdown revealed a critical flaw in the system: those blood samples could take nearly two years to be tested
Science
2 w. Indian AI lab Sarvam’s new models are a major bet on the viability of open
Technology
2 w. Indian AI lab Sarvam’s new models are a major bet on the viability of open source AI
Technology
8 d. 'Milestone' findings on imaging methods call for a closer look at battery microscopy
Science
2 w. A new method to steer AI output uncovers vulnerabilities and potential improvements
Technology
7 d. Washington state’s data center regulation bill fails following pushback from tech industry
Technology
1 M. Musk vows to put data centers in space and run them on solar power but experts have their doubts
Space
6 d. AI and 3D printing help researchers create heat‑ and pressure‑resistant materials for aerospace and defense applications
Technology
6 d. GT 255: ICBM test launch verifies multiple reentry vehicles, system reliability
Automotive
2 w. Pinpointing direction in noisy 2D data: New algorithm could improve imaging, AI, particle research and more
Technology
1 M. Researchers successfully 3D print one of industry's hardest engineering materials
Technology
2 w. Top AI firm alleges Chinese labs used 24K fake accounts to siphon US tech
Technology
1 M. Epstein Files Reveal Scope of Ghislaine Maxwell’s Role in Clinton Circle
Space
2 w. Big Tech Says Generative AI Will Save the Planet. It Doesn’t Offer Much Proof
Technology
3 w. Study argues online clicks and scrolls are 'thin labor' powering AI
Technology
6 d. GT 255: ICBM Test Launch Verifies Multiple Reentry Vehicle and System Reliability
Automotive
1 M. HHS Is Making an AI Tool to Create Hypotheses About Vaccine Injury Claims
Science
2 w. Highlighting Diagnostic Delays, Substantial Burden Across the MS Journey
Science
1 M. Why light poles failed in Hurricane Ian despite meeting design standards
Space
3 h. Daily Digest: Nvidia and Thinking Machines Lab ink AI deal, DC Solar's ex
Technology
1 M. Arctic blast fuels scrutiny of Biden’s $8B electric bus push as watchdogs cite oversight failures
Automotive
5 d. ByteDance’s AI Ambitions Are Being Hampered by Compute Restraints and Copyright Concerns
Technology
1 M. New framework pinpoints conditions that make data augmentation improve robustness
Technology
6 d. A “ChatGPT for spreadsheets” helps solve difficult engineering challenges faster
Technology
6 d. 'ChatGPT for spreadsheets' helps solve difficult engineering challenges faster
Technology
2 w. NASA chief blasts Boeing, space agency for failed Starliner astronaut mission
Space
3 w. Turning down the heat: Researcher identifies better way to remove heat from AI data centers
Technology
1 M. Fundamental raises $255M Series A with a new take on big data analysis
Technology
10 h. Google rolls out new Gemini capabilities to Docs, Sheets, Slides, and Drive
Space
2 w. Key US Export Controls Considerations for Global Data Center Projects – Publications
Technology
3 w. As AI data centers hit power limits, Peak XV backs Indian startup C2i to fix the bottleneck
Technology
3 w. One Utah school district is outpacing the rest of the state when it comes to reading scores. Here’s how.
Education
1 M. As it preps Specs for the masses, Snap’s Q4 shows revenue growth but fewer daily users
Economics
1 M. Schools that let students leave class to protest ICE have failing academic records
Education
3 w. Investigators Hope DNA Testing Can Provide Breakthrough in Guthrie Case
Science
6 d. San Francisco school district investigating math teacher's test questions
Education
2 w. AI model edits can leak sensitive data via update 'fingerprints'
Technology
9 d. AI is getting smarter, but not wiser: A new roadmap aims to fix that gap
Technology
4 w. Nancy Guthrie's Hired Help Submitting DNA Samples As Investigation Continues
Science
2 w. Commentary: RFK Jr.'s attacks on vaccines could undermine American science for generations
Science
2 w. How ‘The Pitt’ portrayed a rape kit exam sensitively with the help of experts
Science
1 w. NASA lost a lunar spacecraft one day after launch. A new report details what went wrong
Space
4 d. Job interviews now include AI and personality tests. Here’s what candidates should know.
Science
Add Watch Country

arrow_drop_down