Your statement, while true, is not practically useful. In theory, it's hard to tell if anything is true. In practice, humans developed a set of shortcuts that allow us to meaningfully navigate reality without getting to the bottom of each trifle. LLMs do have problem with presenting facts and we should not only acknowledge that but also find practical ways to deal with this problem, just like we do to some extent with misinformation in the social media etc.