Scraper structure?

[stordone]

Hi there, I'm going to create my first web scraper and I want know from your experts which structure should I give to my project.

I thought for the moment to create three folders:

• Controllers: contains all the method for scrape specific site page.
• Helpers: general utility for the class.
• Orm: the database relation object.

Is that implementation good? How can I improve it?

Thanks for any hint / help.

[FunkyDexter]

Web scrapers tend to be frowned upon round here because they're most commonly used to violate web site's usage policies. There are legitimate uses or them but if you want to get help you're going to have to tell us which web site(s) you intend to scrape and why.