Scrape any website

Hi,

I got some free time and I'm very quick in building spider for scraping website so I'm offering for free for a short period of time this service. Pm me here or add on skype: skypetomislav

Are we talking about a bot here!
I'm looking for a keyword based content scraping tool that grabs from any number of sources for content curation and such like. AS many sources and scrapes as possible.

Let me know if this is what you are on about.

Scritty

Sure I can write such a bot too, pm me for details or add on skype: skypetomislav

I hope you can distribute what you have developed as a gift to this community.

even though I don't need your services, thanks

I do not need a tool, but if you are an experienced scrapper and use Python I would like to ask a few questions.

You are added to skype, thanks

Most of the time I use python , well how experienced am I relay don't know, but for now I didn't see a website which can't be scraped

Is it free?

Can I have a pinterest image scrapper?

WebScraping said:

Most of the time I use python , well how experienced am I relay don't know, but for now I didn't see a website which can't be scraped

Click to expand...

Cool. There isn't a site that cannot be scraped (except probably javascript ones, where a click is needed), but it is the trick to scrape in the most efficient way.

Also I would like to make python look pretty much the same as VB.net so I could add easy GUI.

So here are few questions (answer to at third one):
1) What IDE do you use (if any)
2) What Gui do you use?
3) What library for scraping?

I could use this

i'm also into scrapping, but using PHP

moonlighsunligh said:

Cool. There isn't a site that cannot be scraped (except probably javascript ones, where a click is needed), but it is the trick to scrape in the most efficient way.

Also I would like to make python look pretty much the same as VB.net so I could add easy GUI.

So here are few questions (answer to at third one):
1) What IDE do you use (if any)
2) What Gui do you use?
3) What library for scraping?

Click to expand...

There are many tricks that work with javascript so scraping this kind of sites is not relay a problem any more. If I need something to be build fast and to deliver data in short time ( few hours) I use scrapy framework for python. As by defaullt this framework doesn't support javascript with a few modifications it can be setup to support.

For all of my programming I use eclipse,GUI-CLI. Ah library , some basic library's You will need to get You started would be the parsers library(lxml,beautiful soup,HtmlXpathSelector...), something that implements the browser request(mechanize,selenium webdriver..) and ofc librarys for storing the data to csv, xml, excel.

Hope it helps, I have posted a short tutorial in prev post, but there are many online tutorials that explain it 100 times better then I did. But again You can allways add me on skype and ask any question You like. I relay like a good challenge when it comes to scraping