[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-ID: <2f6cb7b40603250417h6e9b705dx2ca58ed8d44dbbef@mail.gmail.com>
Date: Sat Mar 25 12:18:21 2006
From: nocfed at gmail.com (nocfed)
Subject: Re: Re: Re: Links to Google's cache
of626FrSIRTexploits
On 3/25/06, Jorrit Kronjee <full-disclosure@...pam.wafel.org> wrote:
> nocfed wrote:
> >
> > You have failed to understand the 'hint' part. It was a hint at ONE
> > of the switches to use..
> >
> > As you apparently have not read the manpage for wget, here is the full command.
> >
> > wget -e robots=off -Hr -nd -np --domains=72.14.203.104 -U Mozilla
> > http://www.elsenot.com/frsirt-google.html
>
> At the risk of stating the obvious and hopefully putting an end to this
> thread, http://www.frsirt.com/robots.txt doesn't contain /exploits/ ? So
> what's your point?
>
> - Jorrit
>
wget is not crawling nor attempting to request anything form frsirt.
google on the other hand DOES use robots which wget will honor by
default.
Powered by blists - more mailing lists