[lug] OT: Viewing website contents.

[Peter Hutnick]

John Dollison said:
> Is there a way to view the contents of a website without going through
> index.html?
>
> (I'm not asking how to view the source code for a particular page; what
> I mean is suppose I visited www.bob.com, and I think he may have a
> BobsBeer.html page and maybe some beer pix, but for some reason he chose
> not to make a link to it from his index page (which may be
> work-related).  Is there any way I can just browse all the files in that
> "web" directory, to see what's available?)

Someone has already mentioned that most sites "block" autoindexing. 
Understand that HTTP does not have "shell-like" features like FTP does.

You /could/ try connecting to the server by anon ftp.  That's rude, however.

You could also try going to http://images.google.com and search for
"site:bob.com beer" and if there have been links to beer images on
*.bob.com lately they should come up.

You can also "navigate blind."  If you know (or have a good guess) about a
page or other file name you can grab it with your browser or wget.  For
example: "wget http://www.bob.com/BobsBeer.html" or "wget
http://www.bob.com/images/guinness_can.jpg"

Happy p0rn snarfing.

-Peter