| |
| |
|
Hardware Information |
|
|
|
Review: Implementing the Google Search Appliance in an Intranet environment
Our corporate intranet is a non-framed environment with both Lotus Domino and IIS (.Net and classic ASP) applications and content. We have between 300,000-500,000 pages of web content and documents across more than 1200 "sites" on approximately 30 unique domains. We used to have Inktomi's UltraSeek Server 3.0 as our intranet search engine which was beginning to look like its age (purchased in 1998). The Inktomi product did not handle attachments well (DOC, PPT, PDF, etc.), would not crawl our secured sites, and was no longer supported by the vendor. We did a cursory review of the search vendors and were immediately attracted to Google's 30 day trial offer for their Google Search Appliance (GSA). After signing a standard agreement, they shipped us a brand new shiny yellow unit which we could test for 30 days before returning or purchasing. Product info The GSA is a "black box" 1U standard rack-mountable server. By "black box" I mean, Google gives you a web interface to administer the device but do not want you to access the Operating System (a heavily Google-customized version of Linux). In fact, the license agreement stipulates that you will not tamper with the hardware or OS of the appliance in any way. The device has no need for a keyboard, mouse or video - all you need for normal operation is a network cable and standard power input. The GSA comes in different flavors to fit different needs varying by size of the hardware and correspondingly size of the license. (Licensing is based on the number of URLs crawled by the appliance.) There are 3 different hardware configurations; the GB-1001, GB-5005, and GB-800. These are broken down as follows;
Why Google? As advertised, the GSA met all of our needs being able to index the large variety of filetypes we have in our environment, access secured content, having a documented API, etc. The Google brand power was another big selling factor. When we told our users that they were going to get a Google-based search engine they knew their days of troubled searching were over. Lastly, the 30-day trial run experience we had with the GSA sealed the deal. The appliance is the easiest enterprise solution I've ever had to install, configure and maintain. We were literally up and running within an hour of opening the shipping box. Installation The appliance has two network ports on the back panel; one for normal operation and the other used exclusively for network configuration. To configure the network settings we connected a laptop to the appliance via a special (some pin-outs are non-standard) orange Ethernet cable which is included. The installation process was about as easy as one can imagine for a "black box." First we plugged in the normal operation network cable and then the power. The power plug on the appliance IS the power switch; plug it in to turn on and unplug it to turn it off. After plugging it in, we waited about 5 minutes for the appliance to play a tune which is the signal to continue. Next, we hooked up our laptop (already set to DHCP mode) to the appliance and powered it up. After logging in to our laptop and making sure we had the correct IP assigned by the appliance's built-in DHCP server we are ready to configure the network settings. Total elapsed time (excluding rack mounting): 10 minutes. Configuration Network configuration, like normal administration, is done entirely through a browser and is a simple 5 step process. The first screens ask you for basic network information; IP address, subnet mask, default gateway, and DNS. Subsequent screens collect SMTP server, "From" address for GSA notification messages, time zone, NTP (time) servers and the admin account name/password. The last step is to test a few URLs which you will be crawling to make sure you've done the setup correctly. After a final settings review screen configuration is complete and you can then unplug your laptop and get to the good part; start crawling. Total elapsed time: 10 minutes. Crawling the site(s) Using the URL provided, all administration of the GSA is done remotely. After logging in with the ID/password we provided in the previous step, we were presented with the Administration console. We created a new collection to hold our index, put in the "Start crawling from" URL, copied that same URL into the "Follow and Crawl only URLs with the Following patterns" box and we were done. We saved our settings and then clicked the "Start crawling" button. We then went over to the "Crawl status" screen and watched the "Crawled URLs" counter increase. Google advertises that it can crawl about 4,000 URLs in about 15 minutes or so. We found the crawl time would increase significantly if there are documents (Word, PDF, Excel, etc.) linked to from those URLS. After the crawl is done the collection is automatically indexed and then checked against the Serving Prerequisites (any criteria you wish to use to determine whether to move an indexed collection to production) and the collection will either be moved to Production (and consequently searchable) or be moved to Staging. The Staging area lets you validate new crawls before letting users search against them. Crawling configuration After your first crawl you may find the need to go back and tweak the crawling parameters. Google gives you a good amount of control over how sites are crawled, the frequency, how many threads are used, etc. For sites with security, the GSA supports Basic Authentication and an additional security module is available which supports Forms Authentication. The most challenging configuration aspects for us were determining the right combination of URL patterns to exclude from the search. If you are a Domino shop and looking to use the GSA you may need to spend some time getting the crawler configuration just right to support the sometimes convoluted Domino query string parameters. After we got the crawl parameters tuned and the first complete crawl done we did some testing to see if the crawler grabbed all the content. Browsing our site and testing with some strings buried deep inside the taxonomy we always found the GSA had crawled them accurately. We also did some testing with strings inside PDF documents, PowerPoint presentations and the like. When we did come across something that hadn't been crawled a careful analysis led us to discover that we needed to do some more tweaking of the crawl settings. Other notable features Google also gives you a KeyMatch tool that allows you to specify which indexed documents should appear at the top of the results page for a given query. These manifest themselves almost identically to the Sponsored Links at the top of the results page of the Google we all use. A Synonym tool allows you to specify alternate words or phrases for search queries. For example, if someone searches for WCM, you can suggest "Web Content Management" at the top of the results page. An output format feature lets you control (via an XSLT) the presentation of the search results. You can use this for changing the fonts, colors, logo, header, etc. of the results page. We were able to easily remove the "Cached" feature on the results page with some XSLT modifications. The Reporting tool lets you run reports on search queries over various time ranges. It will show you the number of searches per day, per hour, the top 100 keywords and top 100 queries for the time period specified. Downsides The GSA is not for organizations looking to index their shared network drives as the appliance has no facility for crawling file systems. This is really too bad as many companies struggle with the huge quantities of unstructured content on stored on their networks. Of course, there are a plethora of other products out there for exactly this issue. Access directly to databases (e.g. SQL, Oracle, etc.) is another area which is off-limits for the GSA as well as any kind of integration with content or document management systems. Conclusion The Google Search Appliance (GSA) is an excellent search product for HTTP-accessible content. It gives great control over administrative features such as crawler configuration and results serving and sufficient reporting capabilities as well. Those looking for a solution to integrate directly with a content/document management system, databases, or indexing network drives should look to another product. However, if you have a intranet or intranet site with plenty of HTML-based content the GSA may be just what you need. Bryan Mjaanes is the creator/editor of Intranet101.com, a community-based forum for Intranet professionals.
MORE RESOURCES:
Hardware - Google News |
|
|
|
RELATED ARTICLES
Emergency Response VSAT Internet Communications As 2005 begins, there are a number of products on the market which enable Emergency Response Units to have internet connectivity at remote disaster locations. The products marketed this year mount on vehicles from Fire Rescue units to most any type of truck or van, on specially designed trailers utilizing portable generators and in transportable boxes which can be shipped by UPS or Fed X overnight to most any location in the U. How to Purchase a Flat Panel TV When purchasing a flat panel TV, there are a few things to keep in mind. Here, we've listed a number of considerations for you to evaluate. Where does technology come from? Ever wonder where all the cool gadgets come from? Ever wonder who gets to try this stuff out first? Usually the war machine scientists get it first, try it out and find an application by using it for destruction; an obvious outlet for the human species and our desire to blow things up. It then moves into the private sector for important projects like, Microwave Ovens, Nuclear Energy, aviation space travel, telecommunications, Internet (which of course Al gore created first?), even Hummers, the ultimate SUV was created to cruise troops around in, Helicopters, hydrofoils, you name it man it came from military first. Dell Inspiron 600m Notebook Computer After twelve years of owning desktop computers, I finally opted for a laptop so I would no longer be chained to my desk. After months of research and weighing various makes and models, I settled on the Dell Inspiron 600m Notebook Computer. Refurbished Laptop Batteries There are three refurbished laptop battery types, each named for its component materials:Nickel Cadmium (NiCad) batteries are hardly ever seen anymore. They have dismally low capacities (2000-3000 mAH) and contain heavy metals that harm the environment. Toner Cartridges - How They Work In the past computers and their accompanying printers were huge. Toner reservoirs and toner cartridges were used instead of ink cartridges like the ones in use today. What Is A Fuse? And How To Test It. A fuse is a very thin wire, which either melts or vaporizes when too much current flows through it. The thin wire may be made of aluminum, tin-coated copper or nickel. Expansion Cards Part 1: (of a 3 part series) PCIThe expansion slots available on motherboards allow for a variety of upgrades in a computer system, but matching the appropriate card to an available slot needs to be addressed before making any purchasing decisions. The most common types of expansion cards for modern computer systems can be broken down into three formats: PCI, AGP, and PCI Express. The Making of Energy Efficient Datacenters The Crooked E: The Unshredded Truth About Enron is a wonderful movie to watch. It is based on the book, The anatomy of greed, written by a former employee of Enron, Brian Cruver. All In One Printers - Home Office Workhorses All in one printers, also known as multifunction printers (MFPs), are printers that also can copy, scan, and in some cases, fax. These machines perform all of these functions, generally using a single set of ink cartridges for both printing and copying. How To Choose The Best Gaming Laptop The gaming laptop is coming of age! It is steadily increasing in popularity as performance quality goes up. Gamers now regularly consider laptops or notebooks when searching for that perfect gaming machine. Ten Tips to Safeguard Your Laptops The following is a list of tips to help safeguard your laptop while traveling or conducting business.1. Your Hard Drive is Going to Explode - Why a UPS is Essential It's most peoples worst computing nightmare. You wake up in the morning, flip on the computer, and it doesn't boot. How to Get the Case Off Your PC! This is the first step to servicing, upgrading or removing PC hardware from your PC. Refer to my other articles on adding, upgading or removing just about any piece of hardware. USB Drive Popularity So many people have small USB drives today, but what is the attracting of owning one?USB drives are very small rewritable storage media for your PC, they can be anywhere from 32 megabytes well over a gigabyte! Despite their growing storage capacity and lowering cost, they can quite literally fit on your keychain! To give you an idea on the size of these drives, they are roughly 3 inches long, under an inch wide and weight almost nothing!USB drives use one of the most common ports on the back of personal computers, the USB port has been in place for many years, and almost every computer built within the last 5-7 years should have a USB port on it. Most new computers have these ports installed on the front of their cases for easy access!USB drives require no additional software to make them work with a new computer, you just plug it in, and a few moments later a new drive will appear in the list of available drives (in My Computer). Learn to Find Cheap Laptop Computers on the Internet Cheap laptop computers are coming to a store near you. In fact, there are many there already. Is A Laser Printer Right For Me? The average home computer user definitely does not need a laser printer. Sure laser printer prices have fallen considerably in the last couple of years. HIPPA Goes Mobile and Wireless for Hospitals and First Responders It appears we need to further streamline health care and HIPPA now in effect is quite a nightmare trying to comply with and implement without making a mistake and possibly being sued as the trial lawyers testing the law. The Malpractice insurance rates may go up again. Moving to a New PC Getting a new PC is exciting and a pain. It's exciting because you get a faster processor, more storage and all the latest stuff even though it's outdated as soon as it hits your desk. Discover Everything About Wholesale Bar Code Reader And Software! It is a given fact that buying wholesale would make us save more money than buying individual items at retail. Purchasing in bulk means more profit for the seller that he could be afforded the leeway of granting discounts.
|
| home | site map |
| © 2006 |
