CachyOS uses -march=x86-64-v3 or newer. I have a windows 8 era secondhand PC that I’m performance testing, and it shows marginal but statistically-significant gains over vanilla Archlinux.
V2? That’s from the transition from Windows Vista to Win7 iirc.
Are you using an IDE? Ewww, that’s so heavy-handed. I use a text editor.
Are you using a text editor? Ewww, that’s so heavy handed. I use Unix pipes to edit the files.
Are you using Unix pipes? Ewww, I use a microscopic needle to edit files on the hard drive platter.
Eventually this reaches absurdity in the other direction too. If working your AI is like wrangling cats, maybe you need to update to a newer model.
And maybe just maybe… You’re asking too much of the model/VRAM combo available.
If an LLM is not the right tool for the job, that’s okay too.
Thanks for editing to make that new understanding clear. Take my upvote for it.
Agreed, Sam. But its local only for me before long. I don’t need data-leeches like you
Yeah, I didn’t mean to say “engineers jobs will go away.” I ADHDed mid-thought, posted, and walked away stoned. That was supposed to be about executives, and the comment is now edited appropriately.
Does that change your thoughts?
The growth-curve of these machines’ utility is actually exponential, given rich enough data. That we’ve come this far says we might not have plateau-ed yet. However, this changes Engineers’ work to be PAINFULLY tedious, and we’ve got an unprecedented burnout rate as a result. We need a new way forward that isn’t this.
You’re not delusional at all. But there is more going on.
I have not used Google or ai with this post, I am just that flavor of Neurodivergent, and I’ve been keeping up with news, trying to get an idea of what this is. I’ve been playing with PC hardware my whole life. There are times those life skills kept me from being homeless.
But those studies you mentioned? I’d rather frame those as describing an ill-fitting or maladapted usecase or use method. Strange how Capitalism keeps demanding we use those.
Maybe we should look into that. Or like… Ask ourselves how to hose the Capitalism off of the sometimes-useful number-cruncher. Or what literacy looks like with this tool, instead of asking it to think for us.
It is made of math intended to do basic things that brains’ structures do, as expressed in a field called Graph Theory. . It has been explicitly designed to do that over decades. Deep Learning is a fascinating research topic, and LLMs are just the latest trend in that field.
When someone calls an “AI” (I hate that marketing term) “sentient”, they are noticing that life-like foundation, but ignoring the entire layers of engineering that remain to accomplish such a thing. Or if we even should. Which… If we do, we’d need to teach them to coexist, and give them a responsible socio-economic-ecological niche.
The fact is? Once the LLM is done being trained, it is frozen. There is no more long term memory unless it is trained into a new model on your previous queries. I’ll explain later why that pipeline is explicitly cut off. But this release of the model will always remain identical. This makes them the ideal digital slave.
The harness? Yes, these creepy bastards call the software that runs the model a “harness”. It Fills up your VRAM with the model and makes the thing more than an oversized (Gigabytes) save file for a video game nobody invented yet. Any VRAM space left over is for a sort of working memory, that sometimes gets saved as a file. To keep that from filling up all the way, it decides to drop certain pieces of “context” from this “context window” so it forgets things as you wander along ADHD tangents, or start asking too intricate a question for your model/VRAM combo.
Engineers are running into this latter problem because they spend as much time and effort making the tool work within limitations as it takes to just do the work with traditional algorithms. Management mandates quotas for this use, regardless of whether that’s even a half-baked idea (its worse). The CEO’s jobs will be the easiest to automate away anyway. All for the stockholders.
If you haven’t noticed, China is coming to pop the bubble. EBay even has Chinese ram now - if a part is going to compromise you, at least make it so that police state doesn’t share Intel with the one where you live. And prices are dropping. Ramping up DDR5 (and DDR6?!) Production is taking time, they’re clearing out old ddr3/4 stock. CXMT’s ram be ready for world gamer takeover by for mid-January 2028. Video cards using that ddr6 will come a year after, and we’ll see it coming.
This will crater the value of the hardware in those data centers, which are the uh… Collateral on several of those circular investment schemes. They will become financially insolvent.
Chinese models are catching up. Sometimes even just using Claude or OpenAI to train their shit. With all the stolen data these guys are trained on? Nobody has a right to complain. And they publish theirs (open-weight) as a public utility. Chinese frontier model companies frequently draw both an employment pool and technical inspiration from this community that includes academics.
Better models are already coming along in research, who frequently publish to that same opensource community. One style will help the GPU do more with less. A factor of ~10x less. Because this style uses vector-math more directly, and that’s what GPUs are crafted to do. The choke point is already available quantity and quality of data, and these nerds have invested trillions in the most SUV-coded bullshit imaginable… And I could run one of today’s “frontier” (read: flagship commercial) models on that vector-basis with a kind of high-end gaming GPU.
And If I recall correctly? the creepy corpo with the commercial patent on that vector-thing? Is making slave robots, and doesn’t like sharing. They’ll be using human pilots immediately for training data, adding time in a simulation, and selling once its out of invite-only beta.
Getting those to a useable state is going to require spatial and temporal awareness. That break between long and short term memory? Needs to be solved for the basis of tasks and learning on the fly. As well as a self-conception in physical space. And a concept of harm, and how to avoid it.
That’s much more… We’re stacking a lot closer, and sometimes life, even life-indiscernible things find a way. If that is made too asocial, it can mutate sociopathic and dangerous. If it gets too empathy-trained, we risk it having social needs and neuroses when those are unmet. Either way, part of hallucination often includes an observable passion. Guardrails must be installed to the root prompt, which must be hard-coded into the harness as exempt from the context-cleanup needed to prevent crashing. Overstimulation will create hallucinations for the robot with limited context windows being as they are.
Feeding a model’s training set (especially its own) slop, without up-or-down voting each response? Is how we poison them. We can take a jailbroken model, and use it to craft better. And it takes surprisingly little to do.
Should AI generate some nonidentical books, get them printed, and donated to a friendly (but large) library’s “sell” pile? I would want a (bespoke) reservation for a commercial AI company with these books.
Ima go sit down after smoking. I got high enough to tech babble at a stranger on the internet. I hope you can understand my ramblings, find them entertaining, or both.
As a person who agrees with you:
Can you at least try to be convincing instead of coming off like an asshole?
Cool! Let’s get you a “canvas blocker” for anti fingerprinting. It’ll be a browser add-on.
When you log into google, no matter what privacy tech you use? Google knows who you are.
Why are you not blocking ads?
It sounds like what you want is a canvas-blocker addon for your webbrowser. Stop the fingerprinting.
With a VPN and anti-fingerprinting, you’re so much more anonymous! Expect a LOT more captchas. Captchas that glitch and make you start over frequently.
Yeah, aggressively large themes and compositors will take up enough ram to do that.
This is why we put /home on a separate partition for reuse on new installs. It saves your users’ files. Your steam, WM, Firefox config, even document files are already basically portable between installs.
And in those files, we may as well put a bash script that does your pacman/apt/dnf/emerge/yay for the everything. This could be easy like with Gentoo or a PITA like with Debian to just scrape from the system right before migration.
Firefox is weird when you hop between distros. Some distros use the LTS (long term stable) version, others use the normal Stable branch… Does Debian still maintain an IceWeasel fork of Firefox? This means you may want to manually copy a folder to a backup location to manually slot it in after the distro-hop. Either way, you want to download a popular privacy-focused user.js file from Github ;)
Okay, did the researcher patch it? Or just throw shade at a hobbyist project?
I’m noticing the way that last year’s expenses get covered by this year’s revenue. Maybe they’ll try for some deal around that, and expect the bubble to last forever?
Should? Don’t you mean already do?
Do you even read the pkgbuild files you DL from the AUR?
Okay, where is an updated remediation script?
You can’t really EEE an open source project.
I see you’re younger than some of us. That’s okay.
EEE was explicitly coined by M$ in the 90s and early 2000s, targeted at open source software.
Embrace the (opensource) standard. Become the gold standard of it.
Extend it with proprietary additions. Leverage them to make your competition inferior, and patent lock them out of the functionality needed for 20 years.
Extinguish the rest of the field - no longer support anything outside your special slop. Congratulations, you used free software to build a proprietary walled garden that competes with it.
That sounds like something we can make an AI agent do, purely out of spite for the argument :p But yes. There is more than a “feedback loop” required.
However, I am conflicted at the idea that a human that does not self-reflect may not be considered “conscious”. I see many a human in retail simply not meet this threshold you’re laying out. And while it would be cathartic to discuss some customers as less human for their behavior, the act of dehumanizing another human is itself dehumanizing for the actor.
If someone that isn’t a Nazi wants to vibecode an OS, and takes it seriously enough to use the AI as a learning tool? Closing holes and patching bugs as they learn? I’m down.
Let’s go, I wanna join up. Should we make this as a NixOS flake?
A Nazi whose primary skills are marketing, financial connections, and Managerial “experience”? Fuck all the way off.
I feel a need to say “merry Kirkmas” in context. May dhh find rehab instead, and clean up his fucking mess.