Web crawler??

[Shy Tall Guy]

I have to go out of town for some family business and I would like to download some of the stories for while I am gone. I am taking my laptop instead of my desktop because hopefully I won't be gone for more than a week, but it's modem is broken, and I don't want to use somebody else's computer to access the Lit site - so I would like to just load the stories onto it.

It would be easier if I just downloaded a number of them using something that can crawl through the links without me having to physically click on every link. Any ideas/recommendations?

Yes I know the stories and website are copyrighted - this is just for my personal offline reading.

Thanks,
STG

 

[Merelan]

I don't know how to help you, except respond so it gets boosted to the top.

To bad Wierd Harold is tied to Laurel's bed or he could help you.

 

[Dixon Carter Lee]

Weeeeeeeeeeeeeeeelllllllllll..........

I think there's a way to get some stories downloaded, but the site is set up so your specifically really can't do tha, for obvious reasons. Now, I'm more of a designer than a tech head, so I can't be sure.

STG go ahead and copy all my stories if you wish. I have no problem with individuals reading them off their screen. But, if anyone does know a way to grab a whole bunch of Lit stories at once, DON'T POST IT. We've already had to harpoon one site that stole 500 stories, we don't want to make it easy for other asshole web masters.

 

[miles]

I don't know if that's possible. You could save each individual story as a Web Page.

 

[Shy Tall Guy]

I don't know if that's possible. You could save each individual story as a Web Page.

Oh it is easy to do - never say impossible to a programmer when you are talking about computer stuff. I could write a Java program that would do it, but I am too lazy to bother. I am sure there are probably defenses web designers can put up, but if it is accessible to anybody via a browser then there are ways around them for a tech head like me. The key is to make it hard enough to were people wouldn't bother.

I just never really had the need to do it, so I was not familiar with what programs worked best.

STG

 

[Shy Tall Guy]

Weeeeeeeeeeeeeeeelllllllllll..........

I think there's a way to get some stories downloaded, but the site is set up so your specifically really can't do tha, for obvious reasons. Now, I'm more of a designer than a tech head, so I can't be sure.

I can easily download stories a web page at a time, but there might be broken links if the page was designed to prevent that. I could take the text too by cut and pasting. But doing that is rather clumsy and time consuming and being a tech head I always look for the lazy way to do something. I wanted to get a good selection of stories as I am not sure ahead of time what I would be in the mood for, or if I would enjoy the story - it is sometimes hard to know if I will like something without reading it, and I like reading stories I haven't already read obviously.

STG go ahead and copy all my stories if you wish. I have no problem with individuals reading them off their screen. But, if anyone does know a way to grab a whole bunch of Lit stories at once, DON'T POST IT. We've already had to harpoon one site that stole 500 stories, we don't want to make it easy for other asshole web masters.

Sounds reasonable - but if someone wants to PM me I will keep it to myself.

Thanks,
STG