Despite all my rage I’m still a rat refreshing this page.

I use arch btw

Credibly accused of being a fascist, liberal, commie, anarchist, child, boomer, and db0’s sockpuppet.

Pronouns are she/her.

Vegan for the iron deficiency.

  • 1 Post
  • 34 Comments
Joined 1 year ago
cake
Cake day: July 2nd, 2023

help-circle


  • I thought they was saying they didn’t mean llms will aid science not that llms wasn’t the topic. Ambiguous in reread.

    AI isn’t well defined which is what I was highlighting with mentions of computer vision etc, that falls into AI and it isn’t really meaningfully different from other diagnostic tools. If people mean agi then they should say that, but it hasn’t even been established it’s likely possible let alone that we’re close.

    There are already many other intelligences on the planet and not many are very useful outside of niches. Even if we make a general intelligence it’s entirely possible we won’t be able to surpass fish level let alone human for example. and even then it’s not clear that intelligence is the primary barrier in anything, which was what I was trying to point out in my science held back post.

    There are so many ifs AGI is a Venus is cloudy -> dinosaurs discussion, you can project anything you like on it but it’s all just fantasy.


  • He literally chooses every single day to actively ignore the plight of the people he claims to rule. He does nothing

    Every single day he actively chooses to ignore suffering, probably even cracks jokes about it, while actively working to preserve his enormous privilege and protect his kin from facing consequences for their heinous actions. He stands at the head of an institution of violence, racism, cruelty, and exploitation and every single moment of his life he chooses to side with that over any earnest attempt to redeem their reputation.

    The entire justification for their privilege is so insane it makes phrenology look respectable.

    He is horrible, he could help so many people with a few words and the equivalent of pocket change but he chooses not to for fear of starting a process that ends with him living as one of the ordinary citizens he claims to protect. It’s fucking bananas that you think there is some moral reasons to extend civility to such a monsterous person.






  • Fair enough, I used to be scientist (a very bad one that never amounted to anything) and my perspective has been that the major barriers to progress are:

    • We’ve just got all the low hangingfruit
    • Science education isn’t available to many people, perspectives are quite limited consequently.
    • power structures are exploitative and ossified, driving away many people
    • industry has too much influence, there isn’t much appetite to fund blue sky projects without obvious short term money earning applications
    • patents slow progress
    • publish or perish incentivises excessive volumes of publication, fraud, and splitting discoveries into multiple papers which increases burden on researchers to stay current
    • nobody wants to pay scientists, bright people end up elsewhere

  • Is it? This seems like a big citation needed moment.

    Have LLMs been used to make big strides? I know some trials are going on aiding doctors in diagnosis and stuff but computer vision algorithms have been doing that for ages (shit contrast dyes, pcr, and blood analysis also do that really) but they come with their own risks and we haven’t seen like widespread unknown illnesses being discovered or anything. Is the tech actually doing anything useful atm or is it all still hype?

    We’ve had algorithms help find new drugs and stuff, or plot out synthetic routes for novel compounds; We can run DFT simulations to help determine if we should try make a material. These things have been helpful but not revolutionary, I’m not sure why LLMs would be? I actually worry they’ll hamper scientific progress by aiding fraud (unreproducible results are already a fucking massive problem) or extremely convincingly lying or omitting something if trying to use one to help in a literature review.

    Why do you think LLMs will revolutionise science?


  • I think it’s really important to keep in mind the separation between doing a task and producing something which looks like the output of a task when talking about these things. The reason being that their output is tremendously convincing regardless of its accuracy, and given that writing text is something we only see human minds do it’s so easy to ascribe intent behind the emission of the model that we have no reason to believe is there.

    Amazingly it turns out that often merely producing something which looks like the output of a task apparently accidentally accomplishes the task on the way. I have no idea why merely predicting the next plausible word can mean that the model emits something similar to what I would write down if I tried to summarise an article! That’s fascinating! but because it isn’t actually setting out to do that there’s no guarantee it did that and if I don’t check the output will be indistinguishable to me because that’s what the models are built to do above all else.

    So I think that’s why we to keep them in closed loops with person -> model -> person, and explaining why and intuiting if a particularly application is potentially dangerous or not is hard if we don’t maintain a clear separation between the different processes driving human vs llm text output.



  • No, they can summarise articles very convincingly! Big difference.

    They have no model of what’s important, or truth. Most of the time they probably do ok but unless you go read the article you’ll never know if they left out something critical, hallucinated details, or inverted the truth or falsity of something.

    That’s the problem, they’re not an intern they don’t have a human mind. They recognise patterns in articles and patterns in summaries, they non deterministically adjust the patterns in the article towards the patterns in summaries of articles. Do you see the problem? They produce stuff that looks very much like an article summary but do not summarise, there is no intent, no guarantee of truth, in fact no concern for truth at all except what incidentally falls out of the statistical probability wells.


  • That’s my point. OP doesn’t know the maths, has probably never implemented any sort of ML, and is smugly confident that people pointing out the flaws in a system generating one token at a time are just parroting some line.

    These tools are excellent at manipulating text (factoring in the biases they have, I wouldn’t recommended trying to use one in a multinational corporation in internal communications for example, as they’ll clobber non euro derived culture) where the user controls both input and output.

    Help me summarise my report, draft an abstract for my paper, remove jargon from my email, rewrite my email in the form of a numbered question list, analyse my tone here, write 5 similar versions of this action scene I drafted to help me refine it. All excellent.

    Teach me something I don’t know (e.g. summarise article, answer question etc?) disaster!



  • Tobias. Totes tragic.

    Rachel becoming a fucked up person who only knew how to live in war was also great.

    Tomorrow when the war began was another childhood fave of mine.

    I wouldn’t say that sort of stuff was unheard of. My mum gave me some super tragic books about Polish kids during the war, there was loads of stuff with like thawing dead soldiers enough to steal boots etc. My mum’s Polish so fed me a lot of grim stuff to read to help understand her parents and their experiences. Idk if you’re usaian? maybe popular stuff was a bit more sanitised because of moral majority stuff?