#Search

[afusiek]

Do you have any recommendations for free writing programs? Because of the rise of ai i don't trust Microsoft Word or Google Docs anymore, but i want to get back to writing. I prefer when i can reach my files online/mobile like docs.

[deep-dark-fears]

Late night searches. A fear submitted by Jackie to Deep Dark Fears - thanks!

You can find original art in my shop!

[mostlysignssomeportents]

Even if you think AI search could be good, it won’t be good

TONIGHT (May 15), I'm in NORTH HOLLYWOOD for a screening of STEPHANIE KELTON'S FINDING THE MONEY; FRIDAY (May 17), I'm at the INTERNET ARCHIVE in SAN FRANCISCO to keynote the 10th anniversary of the AUTHORS ALLIANCE.

The big news in search this week is that Google is continuing its transition to "AI search" – instead of typing in search terms and getting links to websites, you'll ask Google a question and an AI will compose an answer based on things it finds on the web:

https://blog.google/products/search/generative-ai-google-search-may-2024/

Google bills this as "let Google do the googling for you." Rather than searching the web yourself, you'll delegate this task to Google. Hidden in this pitch is a tacit admission that Google is no longer a convenient or reliable way to retrieve information, drowning as it is in AI-generated spam, poorly labeled ads, and SEO garbage:

https://pluralistic.net/2024/05/03/keyword-swarming/#site-reputation-abuse

Googling used to be easy: type in a query, get back a screen of highly relevant results. Today, clicking the top links will take you to sites that paid for placement at the top of the screen (rather than the sites that best match your query). Clicking further down will get you scams, AI slop, or bulk-produced SEO nonsense.

AI-powered search promises to fix this, not by making Google search results better, but by having a bot sort through the search results and discard the nonsense that Google will continue to serve up, and summarize the high quality results.

Now, there are plenty of obvious objections to this plan. For starters, why wouldn't Google just make its search results better? Rather than building a LLM for the sole purpose of sorting through the garbage Google is either paid or tricked into serving up, why not just stop serving up garbage? We know that's possible, because other search engines serve really good results by paying for access to Google's back-end and then filtering the results:

https://pluralistic.net/2024/04/04/teach-me-how-to-shruggie/#kagi

Another obvious objection: why would anyone write the web if the only purpose for doing so is to feed a bot that will summarize what you've written without sending anyone to your webpage? Whether you're a commercial publisher hoping to make money from advertising or subscriptions, or – like me – an open access publisher hoping to change people's minds, why would you invite Google to summarize your work without ever showing it to internet users? Nevermind how unfair that is, think about how implausible it is: if this is the way Google will work in the future, why wouldn't every publisher just block Google's crawler?

A third obvious objection: AI is bad. Not morally bad (though maybe morally bad, too!), but technically bad. It "hallucinates" nonsense answers, including dangerous nonsense. It's a supremely confident liar that can get you killed:

https://www.theguardian.com/technology/2023/sep/01/mushroom-pickers-urged-to-avoid-foraging-books-on-amazon-that-appear-to-be-written-by-ai

The promises of AI are grossly oversold, including the promises Google makes, like its claim that its AI had discovered millions of useful new materials. In reality, the number of useful new materials Deepmind had discovered was zero:

https://pluralistic.net/2024/04/23/maximal-plausibility/#reverse-centaurs

This is true of all of AI's most impressive demos. Often, "AI" turns out to be low-waged human workers in a distant call-center pretending to be robots:

https://pluralistic.net/2024/01/31/neural-interface-beta-tester/#tailfins

Sometimes, the AI robot dancing on stage turns out to literally be just a person in a robot suit pretending to be a robot:

https://pluralistic.net/2024/01/29/pay-no-attention/#to-the-little-man-behind-the-curtain

The AI video demos that represent "an existential threat to Hollywood filmmaking" turn out to be so cumbersome as to be practically useless (and vastly inferior to existing production techniques):

https://www.wheresyoured.at/expectations-versus-reality/

But let's take Google at its word. Let's stipulate that:

a) It can't fix search, only add a slop-filtering AI layer on top of it; and

b) The rest of the world will continue to let Google index its pages even if they derive no benefit from doing so; and

c) Google will shortly fix its AI, and all the lies about AI capabilities will be revealed to be premature truths that are finally realized.

AI search is still a bad idea. Because beyond all the obvious reasons that AI search is a terrible idea, there's a subtle – and incurable – defect in this plan: AI search – even excellent AI search – makes it far too easy for Google to cheat us, and Google can't stop cheating us.

Remember: enshittification isn't the result of worse people running tech companies today than in the years when tech services were good and useful. Rather, enshittification is rooted in the collapse of constraints that used to prevent those same people from making their services worse in service to increasing their profit margins:

https://pluralistic.net/2024/03/26/glitchbread/#electronic-shelf-tags

These companies always had the capacity to siphon value away from business customers (like publishers) and end-users (like searchers). That comes with the territory: digital businesses can alter their "business logic" from instant to instant, and for each user, allowing them to change payouts, prices and ranking. I call this "twiddling": turning the knobs on the system's back-end to make sure the house always wins:

https://pluralistic.net/2023/02/19/twiddler/

What changed wasn't the character of the leaders of these businesses, nor their capacity to cheat us. What changed was the consequences for cheating. When the tech companies merged to monopoly, they ceased to fear losing your business to a competitor.

Google's 90% search market share was attained by bribing everyone who operates a service or platform where you might encounter a search box to connect that box to Google. Spending tens of billions of dollars every year to make sure no one ever encounters a non-Google search is a cheaper way to retain your business than making sure Google is the very best search engine:

https://pluralistic.net/2024/02/21/im-feeling-unlucky/#not-up-to-the-task

Competition was once a threat to Google; for years, its mantra was "competition is a click away." Today, competition is all but nonexistent.

Then the surveillance business consolidated into a small number of firms. Two companies dominate the commercial surveillance industry: Google and Meta, and they collude to rig the market:

https://en.wikipedia.org/wiki/Jedi_Blue

That consolidation inevitably leads to regulatory capture: shorn of competitive pressure, the companies that dominate the sector can converge on a single message to policymakers and use their monopoly profits to turn that message into policy:

https://pluralistic.net/2022/06/05/regulatory-capture/

This is why Google doesn't have to worry about privacy laws. They've successfully prevented the passage of a US federal consumer privacy law. The last time the US passed a federal consumer privacy law was in 1988. It's a law that bans video store clerks from telling the newspapers which VHS cassettes you rented:

https://en.wikipedia.org/wiki/Video_Privacy_Protection_Act

In Europe, Google's vast profits lets it fly an Irish flag of convenience, thus taking advantage of Ireland's tolerance for tax evasion and violations of European privacy law:

https://pluralistic.net/2023/05/15/finnegans-snooze/#dirty-old-town

Google doesn't fear competition, it doesn't fear regulation, and it also doesn't fear rival technologies. Google and its fellow Big Tech cartel members have expanded IP law to allow it to prevent third parties from reverse-engineer, hacking, or scraping its services. Google doesn't have to worry about ad-blocking, tracker blocking, or scrapers that filter out Google's lucrative, low-quality results:

https://locusmag.com/2020/09/cory-doctorow-ip/

Google doesn't fear competition, it doesn't fear regulation, it doesn't fear rival technology and it doesn't fear its workers. Google's workforce once enjoyed enormous sway over the company's direction, thanks to their scarcity and market power. But Google has outgrown its dependence on its workers, and lays them off in vast numbers, even as it increases its profits and pisses away tens of billions on stock buybacks:

https://pluralistic.net/2023/11/25/moral-injury/#enshittification

Google is fearless. It doesn't fear losing your business, or being punished by regulators, or being mired in guerrilla warfare with rival engineers. It certainly doesn't fear its workers.

Making search worse is good for Google. Reducing search quality increases the number of queries, and thus ads, that each user must make to find their answers:

https://pluralistic.net/2024/04/24/naming-names/#prabhakar-raghavan

If Google can make things worse for searchers without losing their business, it can make more money for itself. Without the discipline of markets, regulators, tech or workers, it has no impediment to transferring value from searchers and publishers to itself.

Which brings me back to AI search. When Google substitutes its own summaries for links to pages, it creates innumerable opportunities to charge publishers for preferential placement in those summaries.

This is true of any algorithmic feed: while such feeds are important – even vital – for making sense of huge amounts of information, they can also be used to play a high-speed shell-game that makes suckers out of the rest of us:

https://pluralistic.net/2024/05/11/for-you/#the-algorithm-tm

When you trust someone to summarize the truth for you, you become terribly vulnerable to their self-serving lies. In an ideal world, these intermediaries would be "fiduciaries," with a solemn (and legally binding) duty to put your interests ahead of their own:

https://pluralistic.net/2024/05/07/treacherous-computing/#rewilding-the-internet

But Google is clear that its first duty is to its shareholders: not to publishers, not to searchers, not to "partners" or employees.

AI search makes cheating so easy, and Google cheats so much. Indeed, the defects in AI give Google a readymade excuse for any apparent self-dealing: "we didn't tell you a lie because someone paid us to (for example, to recommend a product, or a hotel room, or a political point of view). Sure, they did pay us, but that was just an AI 'hallucination.'"

The existence of well-known AI hallucinations creates a zone of plausible deniability for even more enshittification of Google search. As Madeleine Clare Elish writes, AI serves as a "moral crumple zone":

https://estsjournal.org/index.php/ests/article/view/260

That's why, even if you're willing to believe that Google could make a great AI-based search, we can nevertheless be certain that they won't.

If you'd like an essay-formatted version of this post to read or share, here's a link to it on pluralistic.net, my surveillance-free, ad-free, tracker-free blog:

https://pluralistic.net/2024/05/15/they-trust-me-dumb-fucks/#ai-search

Image: Cryteria (modified) https://commons.wikimedia.org/wiki/File:HAL9000.svg

CC BY 3.0 https://creativecommons.org/licenses/by/3.0/deed.en

--

djhughman https://commons.wikimedia.org/wiki/File:Modular_synthesizer_-_%22Control_Voltage%22_electronic_music_shop_in_Portland_OR_-_School_Photos_PCC_%282015-05-23_12.43.01_by_djhughman%29.jpg

CC BY 2.0 https://creativecommons.org/licenses/by/2.0/deed.en

[wip]

I recently encountered yet another tumblr user who didn't realize that the Blog Settings option to hide your blog from search engines also includes tumblr's own search. It's surprisingly common in my experience, where people for years complain that search is broken for their blog, or that their posts don't show up in the public tags/search, but have no idea it was their own choice that put them in that situation. I know that the explainer text for the "discourage searching of [blog]" option is definitely more detailed than it used be, but if you haven't checked your settings since then, well...

Anyway, is it possible that the option could be separated into "hide from external search engines" and "hide from tumblr's search"? For people who would prefer not to be googleable (and assumed that's the only thing the option was doing) but are ok with their posts showing up in tumblr's own search.

Or possibly the options could be "hide from external search engines" and "turn off tumblr search for my blog"? Or at the very least, could there be further explainer text that hiding your from tumblr's search means that your blog's own searchbar won't ever find anything?

Answer: Hello, @nobodysuspectsthebutterfly!

Well, what do you know. We were looking at this same issue just recently and could not agree more: this setting really should be separated. Ideally, it would look a little something like this:

We need to take another look at this, as splitting search settings into Tumblrs vs. others makes a whole lot of sense. What is less clear is when a member of the team will have the capacity to work on it.

But rest assured we will be adding this to our agenda, and will be in touch with you with updates as and when we have them. And we hope you do not have to wait too long for news on this. We’ll keep you posted!

[lilyflowerpot]

Remus, watching James do push-ups: Woah, he's been going at that for a while now. I wonder where he gets all that motivation.

James, to himself: I'm gonna be so good at hugging my friends. I'm gonna be so good at hugging my friends. I'm gonna be—

[jstor]

Hi Jstor! Bless what you do, but I have to know: is there a way you can filter out reviews of articles? I keep trying to find specific articles for some searches and all I get is reviews by other people OF the specific article.

If it does not exist yet, maybe that's a function to look into eventually? It'd sure make my life easier, I bet others agree. If that's not feasible, I understand.

Thanks!

Hi there, yes you can! Here's a video tutorial we put together a while ago.

[365filmsbyauroranocte]

La bête dans la jungle (Patric Chiha, 2023)

[less-ismore]

Bas Jan Ader, In search of the miraculous, 1973.

[oldwindowsicons]

Netscape - Search

[sonandheirofnothinginparticular]

[alwaysbewoke]

My goodness!!!

[futurebird]

This entomologist does not exist.

I decided to find out if any progress had been made on the science behind why some ants are attracted to electrical fields. After filtering out exterminators (it's so demoralizing to search for information on creatures you love and find nothing but people who know nothing about them boasting about how they will kill them all) I found what looked like a blog. But, who the heck is "James Brown"? Never heard of the dude. Maybe he could be my new friend if he likes ants enough to blog about them!

As far as I can tell, these people are phantoms. That's cruel on multiple levels. If I was not familiar with this SEO (Search Engine Optimization) trick I'd spend time looking for them both (to politely tell them about the errors in their blog... which I would assume they would care about since they love insects.)

But, I know what this is now. It's probably the exterminators behind all of this. To get their page ranks up they need "legitimate" pages such as personal blogs to link to them. So they make fake versions of the blogs.

They are pretending to be *ME*

We are expected to take this kind of BS as "harmless gaming of the system." but I find it incredibly distrustful and hurtful. It's making it harder for people to find each other by putting all these fake people in the way. It's LIES the pages are full of half-true nonsense. It's making people know less and filling their heads with false facts.

And this kind of page is what you find FIRST in nearly all search engines. You won't find Alex Wild or the formiculture forum.

You find these mendacious SEO ghosts.

These fake pages ought to be blacklisted to oblivion. But, I don't see any search engines taking this seriously at all.

Not really in their interest to do that, is it? We need to make more noise about just how terrible these pages are. Fake experts? Fake people? Fake images? Fake facts?

Information pollution & fragmentation of natural networks of human learning. A rot on the body of human knowledge: any search engine that puts such pages at the top should be ashamed.

We had a very lively conversation about this on the fediverse (join us if you've been looking for a better kind of social media.)

[mostlysignssomeportents]

The specific process by which Google enshittified its search

I'm touring my new, nationally bestselling novel The Bezzle! Catch me SATURDAY (Apr 27) in MARIN COUNTY, then Winnipeg (May 2), Calgary (May 3), Vancouver (May 4), and beyond!

All digital businesses have the technical capacity to enshittify: the ability to change the underlying functions of the business from moment to moment and user to user, allowing for the rapid transfer of value between business customers, end users and shareholders:

https://pluralistic.net/2023/02/19/twiddler/

If you'd like an essay-formatted version of this thread to read or share, here's a link to it on pluralistic.net, my surveillance-free, ad-free, tracker-free blog:

https://pluralistic.net/2024/04/24/naming-names/#prabhakar-raghavan

Which raises an important question: why do companies enshittify at a specific moment, after refraining from enshittifying before? After all, a company always has the potential to benefit by treating its business customers and end users worse, by giving them a worse deal. If you charge more for your product and pay your suppliers less, that leaves more money on the table for your investors.

Of course, it's not that simple. While cheating, price-gouging, and degrading your product can produce gains, these tactics also threaten losses. You might lose customers to a rival, or get punished by a regulator, or face mass resignations from your employees who really believe in your product.

Companies choose not to enshittify their products…until they choose to do so. One theory to explain this is that companies are engaged in a process of continuous assessment, gathering data about their competitive risks, their regulators' mettle, their employees' boldness. When these assessments indicate that the conditions are favorable to enshittification, the CEO walks over to the big "enshittification" lever on the wall and yanks it all the way to MAX.

Some companies have certainly done this – and paid the price. Think of Myspace or Yahoo: companies that made themselves worse by reducing quality and gouging on price (be it measured in dollars or attention – that is, ads) before sinking into obscure senescence. These companies made a bet that they could get richer while getting worse, and they were wrong, and they lost out.

But this model doesn't explain the Great Enshittening, in which all the tech companies are enshittifying at the same time. Maybe all these companies are subscribing to the same business newsletter (or, more likely, buying advice from the same management consultancy) (cough McKinsey cough) that is a kind of industry-wide starter pistol for enshittification.

I think it's something else. I think the main job of a CEO is to show up for work every morning and yank on the enshittification lever as hard as you can, in hopes that you can eke out some incremental gains in your company's cost-basis and/or income by shifting value away from your suppliers and customers to yourself.

We get good digital services when the enshittification lever doesn't budge – when it is constrained: by competition, by regulation, by interoperable mods and hacks that undo enshittification (like alternative clients and ad-blockers) and by workers who have bargaining power thanks to a tight labor market or a powerful union:

https://pluralistic.net/2023/11/09/lead-me-not-into-temptation/#chamberlain

When Google ordered its staff to build a secret Chinese search engine that would censor search results and rat out dissidents to the Chinese secret police, googlers revolted and refused, and the project died:

https://en.wikipedia.org/wiki/Dragonfly_(search_engine)

When Google tried to win a US government contract to build AI for drones used to target and murder civilians far from the battlefield, googlers revolted and refused, and the project died:

https://www.nytimes.com/2018/06/01/technology/google-pentagon-project-maven.html

What's happened since – what's behind all the tech companies enshittifying all at once – is that tech worker power has been smashed, especially at Google, where 12,000 workers were fired just months after a $80b stock buyback that would have paid their wages for the next 27 years. Likewise, competition has receded from tech bosses' worries, thanks to lax antitrust enforcement that saw most credible competitors merged into behemoths, or neutralized with predatory pricing schemes. Lax enforcement of other policies – privacy, labor and consumer protection – loosened up the enshittification lever even more. And the expansion of IP rights, which criminalize most kinds of reverse engineering and aftermarket modification, means that interoperability no longer applies friction to the enshittification lever.

Now that every tech boss has an enshittification lever that moves very freely, they can show up for work, yank the enshittification lever, and it goes all the way to MAX. When googlers protested the company's complicity in the genocide in Gaza, Google didn't kill the project – it mass-fired the workers:

https://medium.com/@notechforapartheid/statement-from-google-workers-with-the-no-tech-for-apartheid-campaign-on-googles-indiscriminate-28ba4c9b7ce8

Enshittification is a macroeconomic phenomenon, determined by the regulatory environment for competition, privacy, labor, consumer protection and IP. But enshittification is also a microeconomic phenomenon, the result of innumerable boardroom and product-planning fights within companies in which would-be enshittifiers try to do things that make the company's products and services shittier wrestle with rivals who want to keep things as they are, or make them better, whether out of principle or fear of the consequences.

Those microeconomic wrestling-matches are where we find enshittification's heroes and villains – the people who fight for the user or stand up for a fair deal, versus the people who want to cheat and wreck to make things better for the company and win bonuses and promotions for themselves:

https://locusmag.com/2023/11/commentary-by-cory-doctorow-dont-be-evil/

These microeconomic struggles are usually obscure, because companies are secretive institutions and our glimpses into their deliberations are normally limited to the odd leaked memo, whistleblower tell-all, or spectacular worker revolt. But when a company gets dragged into court, a new window opens into the company's internal operations. That's especially true when the plaintiff is the US government.

Which brings me back to Google, the poster-child for enshittification, a company that revolutionized the internet a quarter of a century ago with a search-engine that was so good that it felt like magic, which has decayed so badly and so rapidly that whole sections of the internet are disappearing from view for the 90% of users who rely on the search engine as their gateway to the internet.

Google is being sued by the DOJ's Antitrust Division, and that means we are getting a very deep look into the company, as its internal emails and memos come to light:

https://pluralistic.net/2023/10/03/not-feeling-lucky/#fundamental-laws-of-economics

Google is a tech company, and tech companies have literary cultures – they run on email and other forms of written communication, even for casual speech, which is more likely to take place in a chat program than at a water-cooler. This means that tech companies have giant databases full of confessions to every crime they've ever committed:

https://pluralistic.net/2023/09/03/big-tech-cant-stop-telling-on-itself/

Large pieces of Google's database-of-crimes are now on display – so much, in fact, that it's hard for anyone to parse through it all and understand what it means. But some people are trying, and coming up with gold. One of those successful prospectors is Ed Zitron, who has produced a staggering account of the precise moment at which Google search tipped over into enshittification, which names the executives at the very heart of the rot:

https://www.wheresyoured.at/the-men-who-killed-google/

Zitron tells the story of a boardroom struggle over search quality, in which Ben Gomes – a long-tenured googler who helped define the company during its best years – lost a fight with Prabhakar Raghavan, a computer scientist turned manager whose tactic for increasing the number of search queries (and thus the number of ads the company could show to searchers) was to decrease the quality of search. That way, searchers would have to spend more time on Google before they found what they were looking for.

Zitron contrasts the background of these two figures. Gomes, the hero, worked at Google for 19 years, solving fantastically hard technical scaling problems and eventually becoming the company's "search czar." Raghavan, the villain, "failed upwards" through his career, including a stint as Yahoo's head of search from 2005-12, a presiding over the collapse of Yahoo's search business. Under Raghavan's leadership, Yahoo's search market-share fell from 30.4% to 14%, and in the end, Yahoo jettisoned its search altogether and replaced it with Bing.

For Zitron, the memos show how Raghavan engineered the ouster of Gomes, with help from the company CEO, the ex-McKinseyite Sundar Pichai. It was a triumph for enshittification, a deliberate decision to make the product worse in order to make it more profitable, under the (correct) belief that the company's exclusivity deals to provide search everywhere from Iphones and Samsungs to Mozilla would mean that the business would face no consequences for doing so.

It a picture of a company that isn't just too big to fail – it's (as FTC Chair Lina Khan put it on The Daily Show) too big to care:

https://www.youtube.com/watch?v=oaDTiWaYfcM

Zitron's done excellent sleuthing through the court exhibits here, and his writeup is incandescently brilliant. But there's one point I quibble with him on. Zitron writes that "It’s because the people running the tech industry are no longer those that built it."

I think that gets it backwards. I think that there were always enshittifiers in the C-suites of these companies. When Page and Brin brought in the war criminal Eric Schmidt to run the company, he surely started every day with a ritual, ferocious tug at that enshittification lever. The difference wasn't who was in the C-suite – the difference was how freely the lever moved.

On Saturday, I wrote:

The platforms used to treat us well and now treat us badly. That's not because they were setting a patient trap, luring us in with good treatment in the expectation of locking us in and turning on us. Tech bosses do not have the executive function to lie in wait for years and years.

https://pluralistic.net/2024/04/22/kargo-kult-kaptialism/#dont-buy-it

Someone on Hacker News called that "silly," adding that "tech bosses do in fact have the executive function to lie in wait for years and years. That's literally the business model of most startups":

https://news.ycombinator.com/item?id=40114339

That's not quite right, though. The business-model of the startup is to yank on the enshittification lever every day. Tech bosses don't lie in wait for the perfect moment to claw away all the value from their employees, users, business customers, and suppliers – they're always trying to get that value. It's only when they become too big to care that they succeed. That's the definition of being too big to care.

In antitrust circles, they sometimes say that "the process is the punishment." No matter what happens to the DOJ's case against Google, its internal workers have been made visible to the public. The secrecy surrounding the Google trial when it was underway meant that a lot of this stuff flew under the radar when it first appeared. But as Zitron's work shows, there is plenty of treasure to be found in that trove of documents that is now permanently in the public domain.

When future scholars study the enshittocene, they will look to accounts like Zitron's to mark the turning points from the old, good internet to the enshitternet. Let's hope those future scholars have a new, good internet on which to publish their findings.

If you'd like an essay-formatted version of this post to read or share, here's a link to it on pluralistic.net, my surveillance-free, ad-free, tracker-free blog:

https://pluralistic.net/2024/04/24/naming-names/#prabhakar-raghavan

[wip]

especially now that you've improved search (thank you!), I'd really really like it if I could make my blog searchable without also having to let it be surfaced in people's recommendations and For You pages and stuff. I want to be able to find stuff on my blog, without being required to also consent to having it algorithmically pushed into random people's faces. It really doesn't seem like those things should all be bundled into the same toggle.

Answer: Hey there, @toasthaste!

This also has a pretty similar answer to this recent question. Adding more privacy and access controls like this is a big task we need to find time for, which requires bandwidth we don’t have right now.

“I want to be able to find stuff on my blog, without being required to also consent to having it algorithmically pushed into random people’s faces.”

That said, we do plan to allow users who have set that they do not want to be searchable on Tumblr to still be able to search their own blogs, and it is on our to-do list!

It is not yet certain when we can get to it, but it is hoped we can get started before the end of the year. We’ll keep you posted—any news, of course, can be found @changes.

Thanks for your question. Keep ’em coming!