stharthjw6j
BANNED
- Dec 23, 2013
- 584
- 251
Thanks, that helps, but what platform for scraping would Google News sites be? Sites like Forbes or Fiji Times show up in Google News. I get Google Alerts sites are more diverse though.
Permanently Closed Marketplace Sales Thread
- Thread starter Sweetfunny
- Start date
- Status
Thanks, that helps, but what platform for scraping would Google News sites be? Sites like Forbes or Fiji Times show up in Google News. I get Google Alerts sites are more diverse though.
alaltaierii
Supreme Member
- Jun 11, 2010
- 1,494
- 388
A lot.
Depending how many connections you want to use when scrapping. For 10 private proxies you can use a single connection in order to keep the IP clean and scrape continuously. Public proxies is an option.
- Aug 7, 2011
- 1,577
- 1,436
Private proxies are not way to go when it comes to mass harvesting. Only public proxies, alot of them.
- Jan 25, 2009
- 6,378
- 3,774
Sweetfunny does not use skype, or any form of live chat/support. You can contact them at
scrapeboxhelp (at] gmail [dot) com
or
support (at] scrapebox {dot] com
Also the vps link is currently working, here it is
http://www.scrapebox.com/vps-servers
As noted above, it would depend. If you are using just basic keyword search then 10 proxies with 1 connection is fine (probably) but if you are using footprints from GSA then your going to likely get footprints with advanced operators and then your going to want 1 connection for every 15-30 proxies. It depends on how often those proxies have got blocked in the past, and how advanced the footprint is.
Google news should be a diverse array of platforms as well, but Scrapebox can only post to the 30+ platforms listed under the platforms button. So the answer is I don't know, I haven't gone to all the news sites and checked.
Do a scrape of the news sites, put in a fake url/name/email/comments and just post and see what sticks.
Generally speaking a lot of times its better to just throw the mud against the wall and see what sticks.
getmomoola
Newbie
- Jun 29, 2013
- 3
- 1
so please dont kill me guys, im slightly new. I have a few questions as to what this bad boy can do, and of course I know there is lots of info on the site about it but it seems there are soooooo many features im a bit lost in all the extras and also the lingo thrown around. I need a few different scrapy type things at the moment and I was just wondering if i can......
1.) Scrape emails from business listings using google maps
2.) suck links/urls off of a specific page
3.) Scrape VCF file/urls - for peoples contact info
4.) extract specific types of data (emails) from vcf files
5.) upload a list of multiple urls/links to scrape emails from
1.) Scrape emails from business listings using google maps
2.) suck links/urls off of a specific page
3.) Scrape VCF file/urls - for peoples contact info
4.) extract specific types of data (emails) from vcf files
5.) upload a list of multiple urls/links to scrape emails from
getmomoola
Newbie
- Jun 29, 2013
- 3
- 1
also i was wondering if any of you experienced users could ballpark what "the extras" would run me in terms of proxies, vps hosting or other, etc. and while im here in this thread I thought who better to ask than you guys.....whats a good method/place to scrape for personal emails within a specific location city/zip etc. I thought craigslist but then noticed they changed their format for listing emails and i believe its sort of useless at this point correct?
Mr. Tokyo
Regular Member
- May 27, 2013
- 241
- 92
I have 50 semi-dedicated proxies from BuyProxies and I want to scrape with a lot of GSA SER advanced operator footprints.
I'm using 1 connection.
Would that be sufficient enough to scrape smoothly without any proxy bans and such?
Last edited:
- Jan 25, 2009
- 6,378
- 3,774
You can scrape emails from urls if the email is in the content of the page, and not in javascript etc... So if you can use google maps to get the actual urls where the emails reside, then you can try and scrape the emails. But Scrapebox won't scrape google maps, as google removed the results from the no javascript pages and scrapebox uses sockets which don't support javascript so it can't use the javascript version so it can't scrape google maps. Lovely run on sentence there.
You can use the link extractor addon to get links/urls from specific pages
Scrapebox will not scrape vcf files or extract data from them. Scrapebox will not scrape any other data besides urls and emails, no phone numbers, no addresses, etc...
Yes just place the list of urls in the urls harvested section and use the email grabber.
Proxies you can get for $10-$50 depending. VPS will run you $50-$100, buy gsa captcha breaker for captchas if you need it or use a service, but I don't know of anything else you would really need.
I don't do personal mailing, its illegal in the US, I only do optin, so I can't tell you the best method to get personal mails or about craigs list in that regard.
ѕє∂σηιc;7268143 said:
30-50 proxies. Depends on the proxies, try and see.
Mr. Tokyo
Regular Member
- May 27, 2013
- 241
- 92
This is so irritating. I guess we all personally have to find this sweet spot depending on type of keywords.
I have 50 semi-dedicated proxies and used them with 1 connection, no delay. I managed to get them all blocked really fast.
After trial and error I've finally found that 10s works without getting my semi-dedicated proxies banned for an hour only. Because after that all my proxies return 403 Forbidden and it burned through all of them and ended the scraping process.
I do not understand how people can harvest millions of URLs every day at that rate.
I have 50 semi-dedicated proxies and used them with 1 connection, no delay. I managed to get them all blocked really fast.
After trial and error I've finally found that 10s works without getting my semi-dedicated proxies banned for an hour only. Because after that all my proxies return 403 Forbidden and it burned through all of them and ended the scraping process.
I do not understand how people can harvest millions of URLs every day at that rate.
Last edited:
- Jan 25, 2009
- 6,378
- 3,774
You can add your own custom googles. Just add them under the Capital D drop down in the main window. Then once they are added they will show up in the the keyword scraper.
ѕє∂σηιc;7268631 said:This is so irritating. I guess we all personally have to find this sweet spot depending on type of keywords.
I have 50 semi-dedicated proxies and used them with 1 connection, no delay. I managed to get them all blocked really fast.
After trial and error I've finally found that 10s works without getting my semi-dedicated proxies banned for an hour only. Because after that all my proxies return 403 Forbidden and it burned through all of them and ended the scraping process.
I do not understand how people can harvest millions of URLs every day at that rate.
Well someone else that is using your semi dedicated proxies may be also using the same engine as you and that will speed up the block process. Also if your proxies have been banned a lot in the past, they can get banned quicker and stay banned longer.
What engine are you scraping?
That typically occurs if you are still running it from the zip file, so make sure you are launching the extracted file and not the one that is still in the zip file.
- Jan 25, 2009
- 6,378
- 3,774
ѕє∂σηιc;7270798 said:
Well there are a lot of advanced operators built into those footprints so you will have to go slow, but that in and of its self shouldn't be an issue with 50 proxies and 1 connection. Are you using those same proxies in another instance of scrapebox scraping google, or in SER its self etc...?
spiritfly
Regular Member
- Apr 30, 2011
- 302
- 132
I have one issues with scrapebox:
When importing keywords that have few unicode characters among them (like french or any latin language) those unicode characters get scrambled. Don't know how to solve this, I tried searching about it, seems like no one has that issue. Very strange! Tried copy paste the kewyrods, they get pasted fine. But when I merge them with footprints, the footprints that have unicode characters get scrambled again. How come no one has complained about this?
When importing keywords that have few unicode characters among them (like french or any latin language) those unicode characters get scrambled. Don't know how to solve this, I tried searching about it, seems like no one has that issue. Very strange! Tried copy paste the kewyrods, they get pasted fine. But when I merge them with footprints, the footprints that have unicode characters get scrambled again. How come no one has complained about this?
Last edited:
dikkill
Power Member
- Jul 27, 2011
- 560
- 127
I have a question for you loopline. Im using a single search operator with a premium keyword list from here. Let's say im scraping for pligg platform, the LPS is great, the scraped results are +6m but when i remove duplicate domains, it removes 75% of the scraped list. What is the problem here? Crappy keyword list?
- Jan 25, 2009
- 6,378
- 3,774
You will need to use the unicode converter addon, it will convert all characters, but the resulting scrape should be accurate.
2.0 will of course have native Unicode support so it will be a non issue soon.
There isn't necessarily an issue. I mean there is a limited amount of pligg platforms out there, and there is a lot of overlap with keywords. So with a lot of internal pages and a limited number of domains, to some extent it is what it is and you just have to keep doing volume scrapes in order to get a desired end result of domains.
- Jul 13, 2008
- 2,219
- 5,431
If you purchase from this thread using the BHW discount, the price is only $57 total and you will not be charged any extra VAT or taxes. We can send you a .pdf invoice if you require one, and ScrapeBox is a single PC license if you need to use it on 2 PC's you will require 2 licenses to do so.
- Status