Build Date: Thu Aug 27 10:40:19 2026 UTC
An intelligent man is sometimes forced to be drunk to spend time with his fools.
-- For Whom the Bell Tolls, Ernest Hemmingway
Web Search Engines Are Falling Down on the Job!
1999-07-07 18:18:38
Scientists say that all of the search engines -- AltaVista, Google, Excite, etc., etc., -- have absolutely MISERABLE performance, and they are getting WORSE. Not a single engine has indexed more than 16% of the Web's estimated 800 million pages.
Even when you combine the results of all the major search engines together, they only cover approximately 40% of the 15 terabytes of data available on the web.
How are you supposed to even do a search like that?! Metacrawler and Dogpile, etc., aren't comprehensive enough. You would have to write your own search tools or something! And that would make you CRAZY!
When the same scientists (researchers at NEC) looked at search engines in 1997, coverage was significantly BETTER. Last time around, some search engines managed to cover as much as a third of the web. So basically, the web has been growing so fast, and getting so OBESE, that the search engines have not been able to keep up for one reason or another...
Meanwhile, HotBot, Excite, Lycos, etc., keep adding new gadgets and features, and redesigning their interfaces and home pages.
AltaVista, for instance, recently added "paid listings" (read: bribes to skew search results) and they redid their home page again this month. That's another thing that the study points out -- search engines are badly BIASED in favor of commercial stuff in the United States. They don't index stuff at universities (.edu) or in Canadia (.ca) as much. So "paid listings" are probably not going to help matters there.
Maybe the search engines should try concentrating on COVERAGE. Barry Rubinson, AltaVista's VP of Engineering, says their index currently contains only 150 million pages. Now AltaVista has a a new "Search Freshness Guarantee," reminiscent of Budweiser's "Born On Dating," which promises that links are only a month old at most. That's great, but how are they going to live up to their stated goal of indexing the ENTIRE WEB?
I mean, GAR!! If you search for "+Pigdog +DiCaprio" NO RESULTS COME BACK. We have told them to index our "Leonardo DiCaprio Exposed As A Freemason!" article a hundred times!
To be fair, AltaVista has been going through some tumultuous times, being sold on the auction block and whatnot, and I don't mean to just pick on them...
Netscape, for another example, just redesigned their search engine, too. It now uses Google instead of Excite, and it has some sort of voodoo shit from "Smart Browsing" thrown in.
Crapola Engine, Northern Lights, supposedly has the most comprehensive index. I just tried a search for "Pigdog" on it, and the whole thing timed out (Uh, great).
The results of this search engine study are published in an article in "Nature." So I'm not making this up. These search engines are quite impotent.
T O P S T O R I E S
John Dvorak has passed. I’m of mixed emotions. First off I’m more positive about his contribution to the overall technology journalism of the early PC days through the 90s, despite how many things he got wrong. He was a firebrand and commanded attention. (More...)
America's National Recording Registry Inducts Culturally Significant Artist - Weezer!
America's Library of Congress calls them "defining sounds of history and culture" and "audio treasures worthy of preservation for all time based on their cultural, historical or aesthetic importance in the nation’s recorded sound heritage." Ladies and gentlemen, I give you... Weezer! (More...)
The Crossroads are real and The Blues is a place; The enduring myth of Robert Johnson (More...)
California Glory Hole attracts huge crowds
A glory hole at Napa's Lake Berryessa is drawing huge crowds. According to Chris Lee, the general manager for the Solano County Water Agency, the glory hole hasn't been active since 2019, and only restarted operations on Feb 4. (More...)
Republican State Senator busted after soliciting a teenage girl
Republican State Senator Justin Eichorn of Minnesota was arrested for soliciting a teen girl on Monday just hours after he introduced a bill proposing "Trump derangement syndrome" (TDS) as a form of mental illness. (More...)
Parents claim measles is not that bad after having only one child die
The parents of a Texas girl who died from the measles are defending their decision not to vaccinate their daughter. "She says they would still say 'Don't do the shots,'" an unidentified translator for the parents said. "They think it’s not as bad as the media is making it out to be." (More...)
C L A S S I C P I G D O G
Spock Went, Spock Wrote, Spock Kicked Ass
Every Labor Day weekend a large portion of the PDJ staff joins 30,000 other freaks at one of the biggest and strangest art festivals in the world - Burning Man - somewhere on the edge of the Black Rock Desert. Our base of operations is always the ultra swank Spock Mountain Research Labs - the World Leaders in Beverage Science and Leisure Technology. This year, we hauled up our computers, printers and a massive digital duplicator, determined to become Black Rock City's third daily newspaper. Even Spock was surprised by our success - news will never be viewed the same on the playa. Read all seven issues of the 2002 Spock Science Monitor for yourself and see why. (More...)
Songs Of Love And Special Things
Well, dear reader, there's no denying it: Spring has sprung. The air is pungent with the fertile aroma of Romance. And you know what goes with Romance, don't you? That's right, Lover, porn. And not just any porn, but the kind you can sing along to. (More...)
Patient Joab's scientifick editorial discusses aspect of the space-time-beer continuum never before processed by sub-bush-robot minds!!! Too fabulantastic to contempulate! (More...)
On the Implementation of a Grocery Bag And Overforestation Initiative
Patient Joab and his evil cohort, Patient Steve, develop a proposal for the plastic-v.-paper problem that EVERYONE can be happy with. An EXCLUSIVE from Spock Mountain Research Labs! (More...)
Brother Wayne Lays Down the Truth
Flesh interviews Wayne Kramer of MC5. (More...)
The Ancient and Correct Sake Ceremony
Many Americans have learned to appreciate the delicate, sophisticated flavors of Japanese food and drink, along with the beautifully refined rituals of Japanese dining. San Francisco, as a gateway between East and West, has especially benefited from the flowering of Eastern consciousness in America. It is hardly possible to walk down the street without stepping on somebody's sushi. (More...)
