Scrapebox newbie

Billy567

Registered Member
Joined
Oct 17, 2018
Messages
72
Reaction score
19
What I'm trying to do is search for my niche in every town in the UK and the info I'm trying to get is url email postcode phone number. Is scrapebox my way to that information. I got some urls then scraped for emails but they didn't match up with the urls so had to go through emails manually matching to url, so I need a way of scraping all in one go.
Any help would be appreciated
 
Thread moved to a more suitable sub forum, have you checked TUTs from @loopline ?
 
What I'm trying to do is search for my niche in every town in the UK and the info I'm trying to get is url email postcode phone number. Is scrapebox my way to that information. I got some urls then scraped for emails but they didn't match up with the urls so had to go through emails manually matching to url, so I need a way of scraping all in one go.
Any help would be appreciated
You would have to first get the urls, assuming your scraping that from google or some search engine. Once you have the urls, if the sites are all formatted the same then you could get the email and phone and postcode, in 1 go, using the custom data scraper that is part of the email scraper plugin.

However the email scraper has an option to save the urls with it, you just need to turn it on. Its literally the only option when you click on the options drop down in the email scraper.

If you use the email scraper it will get the mails and you can use the phone number scraper and build in your phone formats and it will get it and then you could use the basic custom data scraper that is part of the core of scrapebox. That would get it done, but you would have to post process to get all that data together in 1 file, like an excel sheet.

As for the custom data scraper that is part of the email scraper, it could do it in 1 shot. You just need to understand that on the post code, regardless of if you use the email scraper plugin or the basic custom data scraper, that if the formatting isn't the same, and you can't find a regex that matches the formatting, you may get less then desireable results.

You might do better using the yellow pages scraper and scraping yell. Bearing in mind that that requires a LOOOOOT of proxies, if you have a lot of locations.

Relevant videos





 
Thanks for the help it's much appreciated :D
 
What I'm trying to do is search for my niche in every town in the UK and the info I'm trying to get is url email postcode phone number. Is scrapebox my way to that information. I got some urls then scraped for emails but they didn't match up with the urls so had to go through emails manually matching to url, so I need a way of scraping all in one go.
Any help would be appreciated


Use the Yellow pages scraper (premium addon)
It does exactly what you've described. You will need a LOT of public and/or private proxies to scrape the yell/yellow pages type sites quickly.

upload_2018-12-24_6-10-33.png



Or do it with one thread and lots of delay, slow and steady

upload_2018-12-24_6-12-49.png
 
I want to put harvested websites into Url's 'harvested' box then run a search that will give 'Company name' 'post code (UK)' 'phone number' 'email address' 'description', other nice to have would be 'opening hours' and an 'image url'. I would need all of the above to be saved to file with the url. Is the code I need to create available for me to share and input into my Scrapebox programme. The other help I need is... do I need to be using proxies when running this scrape? Also so where is the best place to get proxies and what type of proxies should I be looking for? Also I might do my scraping by individual town and city.
I know this is asking a lot but if anyone knows how to do this and is willing to share it with me I would be so grateful.
If this is an impossible task and Scrapebox can't be used in this way I would be interested to hear as then it would stop me wasting time trying to get this information.
As I was writing the question(s) above I have read the previous post, so thank you for that, the problem I have got is I could buy this yellow pages add on and still not understand how to run that as my knowledge of Scrapebox is so low. I like to learn new skills but I must admit I'm really struggling with Scrapebox.
Thank you to all who have contributed to my post and to any that post after this reply.
 
Use the custom grabber.







upload_2018-12-24_8-29-11.png



upload_2018-12-24_8-28-17.png
 

Attachments

  • upload_2018-12-24_8-28-46.png
    upload_2018-12-24_8-28-46.png
    137.1 KB · Views: 4
Last edited:
Example custom grabber for phone numbers

upload_2018-12-24_8-33-54.png
 

Attachments

  • upload_2018-12-24_8-31-9.png
    upload_2018-12-24_8-31-9.png
    28.8 KB · Views: 5
  • PhoneNumbers.zip
    PhoneNumbers.zip
    589 bytes · Views: 4
Thanks for the examples:p
I'm a little concerned of just pressing the button as people say you can get your IP banned, so what should I do about proxies.
I just want to try these things but don't want any adverse consequences.;)
Also what should I set connections and timeout at? and are there any other variables I should be aware of.:D
 
The defaults out of the box are pretty good. Lower your threads, particular for ''harvester'' if you're worried about getting blocked.
 
Thanks for the examples:p
I'm a little concerned of just pressing the button as people say you can get your IP banned, so what should I do about proxies.
I just want to try these things but don't want any adverse consequences.;)
Also what should I set connections and timeout at? and are there any other variables I should be aware of.:D
If you keep connections low, you don't need proxies for custom data grabber. I would go with connections at 2-3 if not using proxies.
 
Back
Top