[Livehttpheaders] Livehttpheaders: New Feedback from Brian

notes at mozdev.org notes at mozdev.org
Thu Feb 19 03:09:07 EST 2004


Add a filtering capability so I can skip requests of certain content types.  Your tool is semi-helpfull when building web spiders, but I often have to spend a lot of time removing unwanted entries like images and redirects.  

I'd also like to be able to get the output as XML so I can (easily) write a script to convert the output into spidering code.

More information about the Livehttpheaders mailing list