Build Date: Sat Sep 5 02:40:19 2026 UTC
I imagine I can last until the absinthe runs out; then, I'm afraid, I'll have to work.
-- HST
Web Search Engines Are Falling Down on the Job!
1999-07-07 18:18:38
Scientists say that all of the search engines -- AltaVista, Google, Excite, etc., etc., -- have absolutely MISERABLE performance, and they are getting WORSE. Not a single engine has indexed more than 16% of the Web's estimated 800 million pages.
Even when you combine the results of all the major search engines together, they only cover approximately 40% of the 15 terabytes of data available on the web.
How are you supposed to even do a search like that?! Metacrawler and Dogpile, etc., aren't comprehensive enough. You would have to write your own search tools or something! And that would make you CRAZY!
When the same scientists (researchers at NEC) looked at search engines in 1997, coverage was significantly BETTER. Last time around, some search engines managed to cover as much as a third of the web. So basically, the web has been growing so fast, and getting so OBESE, that the search engines have not been able to keep up for one reason or another...
Meanwhile, HotBot, Excite, Lycos, etc., keep adding new gadgets and features, and redesigning their interfaces and home pages.
AltaVista, for instance, recently added "paid listings" (read: bribes to skew search results) and they redid their home page again this month. That's another thing that the study points out -- search engines are badly BIASED in favor of commercial stuff in the United States. They don't index stuff at universities (.edu) or in Canadia (.ca) as much. So "paid listings" are probably not going to help matters there.
Maybe the search engines should try concentrating on COVERAGE. Barry Rubinson, AltaVista's VP of Engineering, says their index currently contains only 150 million pages. Now AltaVista has a a new "Search Freshness Guarantee," reminiscent of Budweiser's "Born On Dating," which promises that links are only a month old at most. That's great, but how are they going to live up to their stated goal of indexing the ENTIRE WEB?
I mean, GAR!! If you search for "+Pigdog +DiCaprio" NO RESULTS COME BACK. We have told them to index our "Leonardo DiCaprio Exposed As A Freemason!" article a hundred times!
To be fair, AltaVista has been going through some tumultuous times, being sold on the auction block and whatnot, and I don't mean to just pick on them...
Netscape, for another example, just redesigned their search engine, too. It now uses Google instead of Excite, and it has some sort of voodoo shit from "Smart Browsing" thrown in.
Crapola Engine, Northern Lights, supposedly has the most comprehensive index. I just tried a search for "Pigdog" on it, and the whole thing timed out (Uh, great).
The results of this search engine study are published in an article in "Nature." So I'm not making this up. These search engines are quite impotent.
T O P S T O R I E S
John Dvorak has passed. I’m of mixed emotions. First off I’m more positive about his contribution to the overall technology journalism of the early PC days through the 90s, despite how many things he got wrong. He was a firebrand and commanded attention. (More...)
America's National Recording Registry Inducts Culturally Significant Artist - Weezer!
America's Library of Congress calls them "defining sounds of history and culture" and "audio treasures worthy of preservation for all time based on their cultural, historical or aesthetic importance in the nation’s recorded sound heritage." Ladies and gentlemen, I give you... Weezer! (More...)
The Crossroads are real and The Blues is a place; The enduring myth of Robert Johnson (More...)
California Glory Hole attracts huge crowds
A glory hole at Napa's Lake Berryessa is drawing huge crowds. According to Chris Lee, the general manager for the Solano County Water Agency, the glory hole hasn't been active since 2019, and only restarted operations on Feb 4. (More...)
Republican State Senator busted after soliciting a teenage girl
Republican State Senator Justin Eichorn of Minnesota was arrested for soliciting a teen girl on Monday just hours after he introduced a bill proposing "Trump derangement syndrome" (TDS) as a form of mental illness. (More...)
Parents claim measles is not that bad after having only one child die
The parents of a Texas girl who died from the measles are defending their decision not to vaccinate their daughter. "She says they would still say 'Don't do the shots,'" an unidentified translator for the parents said. "They think it’s not as bad as the media is making it out to be." (More...)
C L A S S I C P I G D O G
Poor Metallica. All they want is to continue to put out the same weak "Heavy Metal" they've been churning out since the "And Justice For All" days? and make gooey wads of cash in the process. The problem is, people aren't buying their bound for the heavy metal scrap heap, over-produced, uninspired, tired crap. And let's face it, their various commercial endorsements won't pay for the lifestyle they've become comfortably accustomed to. Resorting to lawsuits makes perfect sense, when you need spending money. But just one lawsuit isn't going to pay their bills. So, to aid Metallica, I've composed an open letter to the boys in the band, with suggestions as to whom else they might sic their lapdog lawyers on... (More...)
It was early in May last year when I first heard about Spock Mountain Research Labs. I was working on a story about a Hungarian scientist's new approach to nucleopeptide synthesis when I got a call from my friend Albert. (More...)
Vacationing from Somnambulant Narrow Realities
So about six months ago, I was chilling in Chang Mai, Thailand with ICBINJ, perursing the Bangkok Times over my banana pancake and Big Chang breakfast when I spotted this article reprinted from the LA Times. It was about some kooks from California (where else?) who were claiming to have been to the front lines in Afgahnistan in mid-December and had recorded the whole feat on their website. "Holy Fuck!" I thought, "Now That's web journalism. Who are these guys!?" (More...)
What the hell is going on with Sony?
Is anyone else as confused as I am with what's happening with the Sony Playstation network hack? (More...)
The Ancient and Correct Sake Ceremony
Many Americans have learned to appreciate the delicate, sophisticated flavors of Japanese food and drink, along with the beautifully refined rituals of Japanese dining. San Francisco, as a gateway between East and West, has especially benefited from the flowering of Eastern consciousness in America. It is hardly possible to walk down the street without stepping on somebody's sushi. (More...)
An innocent trip to the Central Market resulted in a severe attack of arachnophobia (and a meal) when a depraved street kid set her vicious pet spider on an unsuspecting shopper. (More...)
