

In further discussions with Claude…
Nah, this ain’t it. I too wish it was just using an LLM to get a head start on translation, but apparently they’re getting the LLM, which has been trained on mathematical proofs, to generate mathematical proofs from text that the LLM is told contains mathematical proofs.
That’s hallucination city.
I wish The Guardian included links to other more technical sources rather than just replying on their own direct communication with the researcher.
Unfortunately in the current environment, giving people the benefit of the doubt has been very over-extended.
I have not read through the papers they have put out, maybe there’s something more in there:
https://researchportal.helsinki.fi/en/persons/jan-von-plato/publications/