Ways to Scrape URLs

So I am using Free URL Scraper, its a easy PHP script witch you can modify with filezilla to search only for urls in your language.

But maybe there are better ways out there to collect urls? *PM also searching for lists..

cheers

Ofcourse there are better ways to scrape.

I would go with scrapy if i was you, or you can go for slybot. Slybot is based on scrapy and scrapely but they do have some cool functions where you can extract generic forms. By the way, slybot actually is a lot better since you can pretty much extract a lot more stuff with scrapely , although I have to say I rather use BeautifulSoup to parse html.

That depends for what purpose are you scraping the url's , for link building use scrapebox(manual) otherwise for some other purpose I would use scrapy for my own crawlers .

Actually I want to scrape urls for my domain valuation website to grow the database

will try slybot now, thx for the suggestion