No AI summary available for this article.
Why It Matters
Reproducibility is essential for scientific research, yet prior work shows that LLM outputs vary with hardware and batching.
Provenance
Discovered via ArXiv and published by ArXiv.
Key Claims
Original description
Reproducibility is essential for scientific research, yet prior work shows that LLM outputs vary with hardware and batching. We identify an overlooked factor: the hidden injection of the current date into system prompts, which users cannot control and which changes every day. Across 9 recent LLMs and 6 datasets spanning multiple-choice QA (MCQA), math reasoning, code generation, and machine translation, performance varies solely with the current date, with deltas of up to 6% on MCQA, 14% on math reasoning, 7% on code generation, and 2.84 BLEU on machine translation. Model rankings also shift,...
Discovered via ArXiv
Research papers and preprints from arXiv.
Publisher: arxiv.org
ID: http://arxiv.org/abs/2609.36931v1 · Indexed about 2 hours ago