I got an email today from someone looking for a tutorial or resources on
writing a metasearch engine. I got the email because I've written three of
them over the past six years or so.
I told the person that I know of no tutorials or references about writing
metasearch engines since when I started, there were about two in existance
that I knew of and that to me, it was pretty straightforward what you need
to do in order to write a metasearch engine: you get query (using CGI most
likely), reformat the queries for each engine you support and make the
request like a browser would (which means you need to support HTTP and CGI
from the client side) and then process the pages you get back (so you need
to parse HTML) and display output like any CGI script can.
Okay, maybe not that easy as there are some nagging details you
only find out about by doing an actual implementation (like certain IIS
servers will send out two complete header sections, or that IIS doesn't
follow the HTTP redirect specification at all, and what exactly are you
supposed to do if you get a redirect on a
POST?) but if you take it piece by piece it's not that overwhelming.
Or is it just me?
Obligatory Contact Info
You have my permission to link freely to any entry here. Go
ahead, I won't bite. I promise.
The dates are the permanent links to that day's entries (or
entry, if there is only one entry). The titles are the permanent
links to that entry only. The format for the links are
simple: Start with the base link for this site: https://boston.conman.org/, then add the date you are
interested in, say 2000/08/01,
so that would make the final URL:
You can also specify the entire month by leaving off the day
portion. You can even select an arbitrary portion of time.
You may also note subtle shading of the links and that's
intentional: the “closer” the link is (relative to the
page) the “brighter” it appears. It's an experiment in
using color shading to denote the distance a link is from here. If
you don't notice it, don't worry; it's not all that
It is assumed that every brand name, slogan, corporate name,
symbol, design element, et cetera mentioned in these pages is a
protected and/or trademarked entity, the sole property of its
owner(s), and acknowledgement of this status is implied.