Oh wow. Yes, this is a problem. Specifically "The primary problem is that while the answers which ChatGPT produces have a high rate of being incorrect, they typically *look* like they might be good and the answers are *very* easy to produce" https://t.co/sGZzBXvgS0