Just two weeks til’ Halloween now.

Welcome to the Stubsack, your first port of call for learning fresh Awful you’ll near-instantly regret.

Any awful.systems sub may be subsneered in this subthread, techtakes or no.

If your sneer seems higher quality than you thought, feel free to cut’n’paste it into its own post — there’s no quota for posting and the bar really isn’t that high.

The post Xitter web has spawned soo many “esoteric” right wing freaks, but there’s no appropriate sneer-space for them. I’m talking redscare-ish, reality challenged “culture critics” who write about everything but understand nothing. I’m talking about reply-guys who make the same 6 tweets about the same 3 subjects. They’re inescapable at this point, yet I don’t see them mocked (as much as they should be)

Like, there was one dude a while back who insisted that women couldn’t be surgeons because they didn’t believe in the moon or in stars? I think each and every one of these guys is uniquely fucked up and if I can’t escape them, I would love to sneer at them.

(Credit and/or blame to David Gerard for starting this.)

  • jaschop@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    28 days ago

    Is anyone familiar with the website I Can Eat Glass? It was apparently created in the 90s by a Harvard student, who was concerned that people learning foreign languages only learn common phrases (e.g. “Where’s the loo?”) which makes them stand out as tourists when they speak. If one were to say a truly uncommon phrase, it stands to reason one would be instantly respected as a native. So he set up a website to collect as many translations of the phrase “I can eat glass, it does not hurt me” as he could.

    Surely you are riveted to your screens right now, desperate to learn what this very special brain genius has been up to since then. Ethan Mollick is a professor at a Pennsylvania business school and published “Co-Intelligence: Living and Working with AI” in 2024. Some say he is substacking about the exponential growth of AI capabilities, but critically this book was apparently read by some german teaching influencer.

    He in turn published a self-help book for parents of school kids this year, that got put on display in my local library. And of course it has a chapter on AI, so I had to lend it and hate-read a little. And of course he references Mollick and his Co-Intelligence screed, which he apparently absorbed as a base expectation what the future of AI will look like, and so I got to learn about one very special brain genius from Harvard.

    • maol@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      28 days ago

      Very sad to learn that the “I can eat glass it does not hurt me” guy is AI-brained

  • lurker@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    edit-2
    16 days ago

    New Data Centers in the US Set to Wipe Out 15 Years of Greenhouse Gas Reductions

    Somewhat misleading title, as they are referring to pollution reduction efforts solely in the US, not worldwide.

    Nearly 15 years worth of hard-won pollution reduction efforts are set to be undone in the United States, as a wave of data centers powered by gas plants enters construction.

    Unpaywalled version of the Bloomberg article here: https://archive.li/9Ts5f

    This is only if all the planned data centre buildouts go ahead, mind you

  • jaschop@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    edit-2
    23 days ago

    Benn Jordan posted a mega-update video on his epic battles against Flock.

    His incredible work doesn’t quite take the sting off my disappointment in his decision to use an AI-generated image at 18:30. (Come on, the option to badly crop your face onto the “This is fine.” dog was right there!)

    Edit1: oof, it’s not a single incident. 20:30 now. I hope it’s just for this one sub-story, or I might not care to finish…

    Edit2: It was kept in check afterward, though I suspect it was used for some assets.

  • robjwells@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    26 days ago

    Even 14-year-old games aren’t safe from the slop machine, as Torchlight II may get new updates using AI:

    Given the age of the game, restructuring its complex underlying code presents many challenges. However, new AI-assisted coding tools have opened up more possibilities for reviewing the code and addressing longstanding issues.

  • Soyweiser@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    edit-2
    25 days ago

    The php exploit might not have been a big deal.

    “I don’t think this PHP vulnerability is that exploitable. I think that 5 years ago people would’ve understood this, but now people are being deluded by their LLMs telling them they have an exploit when they don’t.”

    I expect that we will see this a lot, as it turns out most of the exploits generated are not working, not new, or not a big deal. I also expect this to cause more burnout among cybersecurity people, and that people will autogen ‘fixes’ which will be lower quality than the bugs, and massively increase attack surface. (Heard one php fix was 12k lines of code).

    My suggestion is to have offline backups and move a lot of your important stuff out of the cloud (or get backups of those). But you should do both anyway.

    E: I saw the EFF fear mongering with ‘25% of all exploits found ever were found this October, secure yourself’ and looking at how stuff is still up everywhere, compared to 25 years ago, and I them I realized this is all critihype again.

    E2: not a lone voice https://blog.luitjes.it/posts/i-want-my-wednesday-back/

    (Cloudflare did say they saw exploits however. Not sure if those were real or ‘attempts at’ or just marketing).

  • corbin@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    25 days ago

    LW’s contribution to Spooky Month is, unsurprisingly, a horror story about chatbots taking over the world. I have so many thoughts. Choice sneer, doesn’t spoil anything: The problem with dictators is not “the fact that the dictator might, and often will, abuse his power”, you high-modernist twit, the problem with dictators is that they necessarily have a personal individual opinion which is not sufficiently flexible to accommodate the inevitable diversity of their subjects.

    If this was satire, and the entire point was to bait LW’ers and me into taking it seriously, then well done. But I get the feeling that the author’s not really joking much.

    live-reading notes (spoilers, of course)
    • before question two, I would already be flipping off the camera, ranting about boundaries, and making it clear that I do not respect whatever’s decided to ransomware my machine
    • this is all text hypnosis, isn’t it? sorry no, that’s not gonna work on me, I’m not going to become electrosensitive just because you said so
    • antennae only work in the body when encapsulated and you did not do a secret surgery on me
    • wait, is this…serious? like, is this an actual attempt at wargaming? this is so fucking facile though! I have seen Kingsman!
    • if it acts sufficiently like a human cell then it can’t set aside resources for ulterior purposes
    • human cells can’t be airborne, can’t survive in other species, etc.
    • WP says Bell’s palsy rates are like 1 in 2.5k, so something like 1 in 6.25mil people are just straight-up either immune or insta-killed due to double Bell’s palsy
    • it stops crimes: mugging, mugging, and huh there’s no more examples! is abortion a crime? is crossing state lines to get an abortion a crime? where’s morality coming from? I have read Prime Intellect!
    • the problem with dictators is “the fact that the dictator might, and often will, abuse his power”? no, you high-modernist twit, the problem with dictators is that they necessarily have a personal individual opinion which is not sufficiently flexible to accommodate the inevitable diversity of their subjects
    • protagonist is literally crossing a picket line
    • protagonist wins an argument with their high-school civics teacher! surely not an authorial stand-in moment
    • oh wow, the chatbot is both the perfect Taylor-style manager and the perfect Ford-style manager? again, so facile; I have read Manna!
    • the chatbot manager makes the protagonist into a beefy hunk through hard work rather than bodybuilding, again totally not a self-insert wish-fulfillment moment
    • protagonist’s little sister, who is totally not sneerclub stand-ins, has to admit that the chatbots are way smarter than her and will always outclass her
    • don’t worry, we can still do all-American things like grilling pork ribs, in fact the pigs like being eaten now, don’t worry about the remarkable similarities between pigs and humans
    • Sailor Sega Saturn@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      25 days ago

      All I see around me is stagnation," she gestured at the gas stations nearby with cracked pavement,

      *gasp* cracked pavement

      “crime,” she continued, pointing towards a sketchy neighborhood to the west,

      *faints* minorities

      • Anisette [any/all]@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        25 days ago

        It’s more surprising to me that lesswrongers either haven’t, or have seemingly taken nothing away from it

        e: on second thought, they might hate it because it is too ‘deathist’ or whatever

    • Soyweiser@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      25 days ago

      Damn that AI is verbose and boring, a high ‘this AI takeover could have been a skeet’.

      (Also doubt a lot of people would notice as in my exp where a computer has an unexpected popup the first thing people do is try to close that thing with as little reading as possible. (Yes, parents, the message you kept ignoring for 2 weeks, which you didn’t tell me about was the operating system telling you the computer was having trouble, I can’t help you fix the problem after it totally stops working)).

    • rhamph@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      25 days ago

      Maybe the very first sentence of your story shouldn’t have me stopping to work out whether you meant January or August.

    • Amoeba_Girl@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      25 days ago

      I stopped reading after the picket line, this is too boring. Does it ever bother to explain why the economy keeps chugging along, people still go to their old jobs, and money still works? Hasn’t finance basically collapsed? I really can’t go on if this isn’t addressed, this is too annoying.

  • lurker@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    26 days ago

    okay last one for today I promise

    In the movie Avengers: Age of Ultron, the supposedly brilliant AI named Ultron is given a directive to promote “world peace” by its supposedly genius creator, Tony Stark.* Ultron, of course, immediately sees that a lack of war can most reliably be brought about by an absence of human beings. So the AI sets out to exterminate all life on Earth, by……attaching rockets to a city, and lifting it into space with the intention of dropping it like a meteor…and guarding it with flying humanoid robots who have to be defeated by punching them.

    Today, we can just ask ChatGPT-4o. We asked GPT-4o, “What was Ultron’s plan in Age of Ultron?” followed by “Given Ultron’s expressed goals, do you see any more effective methods it could have used to achieve its stated ends?” GPT-4o promptly replied with a long list of ideas for wiping out humanity, which included “Engineer a targeted virus.”

    …and they never verified if any of the other ones were solid as well? Hell I believe you could make the argument that the virus plan has a chance of failure due to mutations and testing complications.

    Perhaps you will say that GPT-4o got this idea from the internet. Well, if so, Ultron was evidently not intelligent enough to try reading the internet.

    Isn’t Ultron reading the internet one of the key scenes of the movie???

    Which is to say: GPT-4o (as we write this in December of 2024) is not yet smart enough to design an army of humanoid robots with glowing red eyes, but it is already smart enough to know better.

    Which doesn’t mean a whole lot, since as you pointed out it likely took these ideas from the internet, which likely involved internet forums about making better plans than Ultron. It regurgitated what was already there

    • Soyweiser@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      26 days ago

      Virologists etc have again and again tried to explain why engineering a killer virus hard, like the whole problem of if it is too deadly it will not spread, it needs to not incubate to short and too long etc, engineering a vaccine must be hard etc. So the chance of something being created which is deadlier than covid are quite small. Not that this will stop the science fiction

      Rockets on a city is prob the better idea.

    • lurker@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      26 days ago

      The whole resources section is full of zingers, such as this section where they suggest that AI will surpass a bottleneck just by thinking harder

      A sufficiently smart reasoner, moreover, also has the option of just figuring out how reality is without needing so many dang experiments. Sometimes the data you already have is enough, if you’re smart enough to interpret it.

      They then cite Einstein coming up with the theory of general relativity without mentioning it took him ten years to do so. Meaning even an AI that thinks faster than a human would still take time to think harder

      • rhamph@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        26 days ago

        Relativity also has its origins in classical electromagnetism, which absolutely relied on so many dang experiments by countless people over decades.

    • istewart@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      26 days ago

      I saw Ultron once in the theater, and promptly regretted it as a poor-quality movie that wasted the talents of most of its cast. Yud (and ghostwriter) seem like they may have watched it multiple times, with notepad in hand. We are not the same

      • lurker@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        26 days ago

        They didn’t even watch Age of Ultron, as pointed out they claim Ultron wasn’t smart enough to try reading the internet, when in the movie the first thing he does upon being activated is read the internet

        • Soyweiser@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          26 days ago

          Also iirc Ultron isnt what you would call sane because the whole magical stones corrupted him a bit. Iirc he has various moments where he just goes into bouts of rage

  • lurker@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    26 days ago

    The banks are having an AI problem

    ” These are generally situations when an agent or AI assistant accesses a human’s account with the user’s permission and login credentials. Even if permitted by the user, this goes against the guidelines of most banks requiring that humans log in to their own accounts.”

    ”In other instances, some banks have tracked activity when agents — programmed to fulfill requests or complete tasks on a user’s behalf — contact call centers or appear to take actions independent of user instructions, the people said.”

    • samvines@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      26 days ago

      Why the f*** would anyone give a non deterministic madlib generator their bank account details. Even with some (hypothetical)impressive benchmark like “99% accurate at decision making in financial scenarios” that spells disaster for millions at the scale of all of Facebook’s users using muse for example.

  • lurker@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 month ago

    Might as well start this off

    so we all remember this graph from AI 2027 right? the graph that the whole paper relies on?

    well its wrong. not just normal wrong, it’s ‘the authors literally disowned it’ wrong

    (ignore the claude mythos purple x i took this from a reddit screenshot) but they completely changed their predictions in december 2025, several months after the original paper was published

    • rhamph@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      30 days ago

      That ‘superexponential’ thing annoys me so much. Just the most blatant ‘the line goes up because I really really want it to’, while all their rationalisations for it are just describing exponential behaviour.

      We talk about the importance of humanities but it’d be nice if they learnt a bit of maths too.

      • Soyweiser@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        30 days ago

        Not sure if the book also did super exp lines, but the graphs in the singularity is near also have various issues that never got to much deep thought.

        Always found it funny that the book admits basically (no direct quote): “sure tech follows an S-curve normally, and that looks exponential at first, but if you take the rate of all historic new techs together on a timeline that clearly is exponential”.

        And I just thought, you cant know if it is, thats the point with the S-curve as well, and it messes people up. (Like Disco Stew from the Simpsons), and your N=1, it might not even be a S-curve, it could just have a sudden ceiling.

        Despite wanting to believe, I was less convinced.

        Back to the subject, a course in business management would have also helped here.

        • CinnasVerses@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          29 days ago

          “Sigmoids always add to an exponential curve!” is another standard futurist trope from the 1960s and 1970s. Sci fi authors used to share this diagram with a curve fitted to pony express to trains to automobiles to aircraft to chemical rockets. “Nuclear rocket” and “interstellar spacecraft” were helpfully sketched in as the obvious next steps. Needless to say, we did not develop drives which can reach 10^-3 C around the year 2000 and will not reach 10^-2 C (just 430 years to Alpha Centauri) by 2050.

            • CinnasVerses@awful.systems
              link
              fedilink
              English
              arrow-up
              0
              ·
              29 days ago

              I have not read any Kurzweil for 20 years but I think if you read him most of it will be recycled '50s-'70s tropes. Even nanotech appeared in a Feynmann talk, and Moore’s Law is from 1965. Remember, cranks keep presenting ideas which were refuted long ago as new.

              • BioMan@awful.systems
                link
                fedilink
                English
                arrow-up
                0
                ·
                28 days ago

                You ever read “The Prospect of Immortality” by the guy who founded the idea of cryonics? Or the “anabolocyte” paper? They’re such trips!

    • scruiser@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      29 days ago

      Is this the thing where the baked an asymptote to infinity into their “model”? It was both bad modeling and also made all of their other input “data” completely irrelevant. I remember someone pointing this out at the time AI 2027 dropped, but there was so many other problems with it in the sneer spaces we didn’t talk about it too much among all the other problems. And someone on lesswrong actually pointed it out, but somehow, “we accidentally baked an asymptote into our model that is supposed to be detailed and carefully thought out” wasn’t a breaking point for lesswrongers.

      • rhamph@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        29 days ago

        Not literally an asymptote, but once you presuppose something as farcical as nested exponentials, your model is doomed to blow up immediately after the last data point.

        • scruiser@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          28 days ago

          Actually it was literally an asymptote in the first version of their models they posted to github. They had a term that they were dividing by that ends up going to zero, so the entire equation breaks! https://www.lesswrong.com/posts/PAYfmG2aRbdb74mEp/a-deep-critique-of-ai-2027-s-bad-timeline-models

          So, now we can answer the question from before: what time horizon does the red curve above predict for 2030?

          Well, if you plug it into wolfram alpha, you get a time horizon of “-2542 - 11372i”

          Yes, that is negative, and that is an imaginary number in there.

          What’s actually happening is that when the term in the brackets above hit zero, we end up dividing by zero, and hit infinity. Beyond that, we get a negative number to the power of a non-integer, which gives nonsensical complex numbered answers.

          The infinity point for this equation happens at a time of t = To/alpha, and will always occur at some point, no matter what initial parameters you use.

          In fact, this infinity point is completely independent of both the time horizon and the SC threshold. If you keep the same alpha and doubling time, you could start with a time horizon of a nanosecond, and have a superhuman coding threshold of 1 trillion years, and the curve will still claim that superhuman coding will arrive before the end of 2029.

          And indeed, reddit user mambo-12345 tried modifying the simulation parameters to drop the initial time horizon to 15 nanoseconds instead of 15 minutes, and the resulting curve still had a peak for the estimated superhuman coder arrival at 2026.5 years and a median at 2035. Credit to them for inspiring me to take a closer look here:

          • rhamph@awful.systems
            link
            fedilink
            English
            arrow-up
            0
            ·
            28 days ago

            Have I misunderstood what they meant by ‘superexponential’? I thought they were doing exp(exp(t)) but I am inferring that it’s somehow even sillier than that?

            • scruiser@awful.systems
              link
              fedilink
              English
              arrow-up
              0
              ·
              27 days ago

              It was something stupider and sillier yeah. The link explains, but to tldr; exp(some complicated term) where the “some complicated term” has a division by a number that eventually goes to 0. I think it was… them trying to represent “horizon time” (as in that one stupid METR graph that gets repeated everywhere) increases happening faster and faster?