Markus Hanke Posted January 20 Share Posted January 20 A lot of people are talking about the ChatGPT project of late, so I decided to try it out for myself, because I was curious. I’ve asked it a lot of technical questions with regards to physics and some other topics, and was pretty impressed how well it was able to answer most of them. However, the AI wasn’t 100% spot-on. At least twice I caught it giving dubious answers - the first one was, with some goodwill, highly misleading; the other one was just flat out wrong. Interestingly, I was able to tell the AI about the wrong answers, and when I asked the same questions again (in a new chat session), it had one of them (not the other one!) corrected. So the moral here is that one should be very careful about using ChatGPT as a source of scientific information - at the very least, the answers it gives should be cross-checked against other sources to ascertain their correctness, and not just accepted at face value. This is an AI, not an online encyclopedia - the system makes mistakes, it learns, and it continuously updates its own internal states. It’s not infallible, so we are well advised to use it with caution. PS. I fear that people referencing AI-generated output from sources such as ChatGPT to backup their arguments is going to become “a thing” before too long on forums such as ours. That’s going to be a problem, for several reasons; most importantly, as mentioned above, AIs make mistakes, and sometimes give wrong answers, so I don’t think we should consider thinks like “ChatGPT said…” to be a valid reference when it comes to backing up arguments. Secondly, I noticed that ChatGPT sometimes answers the same question in different ways, using different wording - so you can’t link to a specific textual answer in a way that others can check and recreate; it’s dynamic output, not static text. That’s problematic when it comes to using it as a reference. What do other people here think? Do you guys feel there might be a need to develop an “AI-Generated Content Policy” for this forum? Link to comment Share on other sites More sharing options...
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!Register a new account
Already have an account? Sign in here.Sign In Now