- cross-posted to:
- technology@lemmy.ml
- cross-posted to:
- technology@lemmy.ml
You must log in or register to comment.
Google never backed up the internet, sure they did cache pages, but that isn’t even close to backing up the internet
Google “Search Liaison” Danny Sullivan confirmed the feature removal in an X post, saying the feature “was meant for helping people access pages when way back, you often couldn’t depend on a page loading. These days, things have greatly improved. So, it was decided to retire it.”
okay but… has it? this seems like an unfounded premise, intuitively speaking
“What excuse could we use for this cost-cutting measure?”
“Uh, we could just say that people don’t need it anymore.”
“Johnson, get that man a promotion!”
“Are you sure? A promotion will cost us more money.”
“Oh right, fire that man!”
Yea I’ve been using it more and more recently, although part of that is sites like Twitter or Reddit randomly hiding content
Bingo. When I read that part of the article, I felt insulted. People see the web getting increasingly enshitified and less accessible. The increased need for cached pages has justified the existence of 12ft.io.
~40% of my web access is now dependant on archive.org and 12ft.io.
So yes, Google is obviously bullshitting. Clearly there is a real reason for nixing cached pages and Google is concealing that reason.
“Enshittification” isn’t just company did bad thing, you know
google be like stop bypassing paywalls and ads using our cache
Wait, how does Google make money off of paywalled contents?
Maybe they don’t want to give rival AI devs data access? It’s not typical for Google to give up data.
As far as we know, Google is not giving up any data. The crawler still must store a copy of the text for the index. The only certainty we have is that Google is no longer sharing it.
From the article:
“was meant for helping people access pages when way back, you often couldn’t depend on a page loading. These days, things have greatly improved. So, it was decided to retire it.” (emphasis added)
Bullshit! The web gets increasingly enshitified and content is less accessible every day.
For now, you can still build your own cache links even without the button, just by going to “https://webcache.googleusercontent.com/search?q=cache:” plus a website URL, or by typing “cache:” plus a URL into Google Search.
You can also use 12ft.io.
Cached links were great if the website was down or quickly changed, but they also gave some insight over the years about how the “Google Bot” web crawler views the web. … A lot of Google Bot details are shrouded in secrecy to hide from SEO spammers, but you could learn a lot by investigating what cached pages look like.
Okay, so there’s a more plausible theory about the real reason for this move. Google may be trying to increase the secrecy of how its crawler functions.
The pages aren’t necessarily rendered like how you would expect.
More importantly, they don’t render the way authors expect. And that’s a fucking good thing! It’s how caching helps give us some escape from enshification. From the 12ft.io faq:
“Prepend 12ft.io/ to the URL webpage, and we’ll try our best to remove the popups, ads, and other visual distractions.”
It also circumvents #paywalls. No doubt there must be legal pressure on Google from angry website owners who want to force their content to come with garbage.
The death of cached sites will mean the Internet Archive has a larger burden of archiving and tracking changes on the world’s webpages.
The possibly good news is that Google’s role shrinks a bit. Any Google shrinkage is a good outcome overall. But there is a concerning relationship between archive.org and Cloudflare. I depend heavily on archive.org largely because Cloudflare has broken ~25% of the web. The day #InternetArchive becomes Cloudflared itself, we’re fucked.
We need several non-profits to archive the web in parallel redundancy with archive.org.
🤖 I’m a bot that provides automatic summaries for articles:
Click here to see the summary
Google Search’s “cached” links have long been an alternative way to load a website that was down or had changed, but now the company is killing them off.
The feature has been appearing and disappearing for some people since December, and currently, we don’t see any cache links in Google Search.
Cached links used to live under the drop-down menu next to every search result on Google’s page.
As the Google web crawler scoured the Internet for new and updated webpages, it would also save a copy of whatever it was seeing.
That quickly led to Google having a backup of basically the entire Internet, using what was probably an uncountable number of petabytes of data.
In 2020, Google switched to mobile-by-default, so for instance, if you visit that cached Ars link from earlier, you get the mobile site.
Saved 68% of original text.
Here’s the heart of the not-so-obvious problem:
Websites treat the Google crawler like a 1st class citizen. Paywalls give Google unpaid junk-free access. Then Google search results direct people to a website that treats humans differently (worse). So Google users are led to sites they cannot access. The heart of the problem is access inequality. Google effectively serves to refer people to sites that are not publicly accessible.
I do not want to see search results I cannot access. Google cache was the equalizer that neutralizes that problem. Now that problem is back in our face.
Is there any sort of way to self host a limited version of this? L
I’d love to be able to have my own Searx also cache everything I visit as I go to it, it’d at least let me refind information I’ve previously found.
You want to self host… the Internet?
No, I want to automatically cache pages I’ve searched for and visited and have them show up on my searx.
We’re talking like maybe 10 pages a week if that.
I know there’s ArchiveBox, but I’m after something less manual and more integrated.
I know what you meant. I was just messing with ya
You could use something like archivebox as that saves the whole page, or you could use Waybackmachine and force it to save the page via an add-on.
You could also setup your own yacy index and everytime you find an interesting site you could add it to yacy.
But this is kind of not what you are asking for. Archivebox is probably the closest, or using squidcache and literally caching every url you go to. 😅
Never seemed feasible to begin with.
