• 0 Posts
  • 14 Comments
Joined 1 year ago
cake
Cake day: July 2nd, 2024

help-circle
  • So, I’m not an expert study-reader or anything, but it looks like they took some questions from the MMLU, modified it in some unspecified way and put it into 3 categories (AI, human, AI-human), and after accounting for skill, determined that people with higher theory of mind had a slightly better outcome than people with lower theory of mind. They determined this based on what the people being tested wrote to the AI, but what they wrote isn’t in the study.
    What they didn’t do is state that people with higher theory of mind are more likely to use AI or anything like that. The study also doesn’t mention empathy at all, though I guess it could be inferred.

    Not that any of that actually matters because how they determined how much “theory of mind” each person had was to ask Gemini 2.5 and GPT-4o.













  • Thing is, that by December 2023, the time of the archive, there was already a scandal with someone using ChatGPT to do the work of discovery. While he might have stopped doing PR work for DoNotPay by that time, he was willing to advertise the fact that he did do such PR work for such a company. It shows either a lack of due diligence in researching his clients, or maybe it was just a paycheque for him. Perhaps he thought he knew more than what he actually did. Or maybe there was something else, I’m not clairvoyant.
    It’s clear that he’s pivoted from that viewpoint, but it does make me curious what happened between then and now that caused him to become skeptical.