Permanently Closed Marketplace Sales Thread
- Thread starter Sweetfunny
- Start date
- Status
fab145
Junior Member
- Dec 13, 2008
- 160
- 54
Hey loopline,
Is there a way to use this "http://www.google.com/search?complete=0&output=ie&hl=en&q={KEYWORD}&filter=0&nfpr=1&ncr=1&num=100&start={PAGENUM}" QueryString on default google scraper in ScrapeBox? I don't want to use this on custom harvester because in custom harvester SB doesn't give any option to transfer not-completed keywords back into keywords list.
Please let me know if there's a way to solve this issue.
Thanks
Is there a way to use this "http://www.google.com/search?complete=0&output=ie&hl=en&q={KEYWORD}&filter=0&nfpr=1&ncr=1&num=100&start={PAGENUM}" QueryString on default google scraper in ScrapeBox? I don't want to use this on custom harvester because in custom harvester SB doesn't give any option to transfer not-completed keywords back into keywords list.
Please let me know if there's a way to solve this issue.
Thanks
- Nov 2, 2008
- 59,110
- 26,627
hay mat , question, i tried scraping some links the other day
for proxies to toss on my s/box thread
listing google - last 24 hrs -- and it was returning links for
2011-2012-2013 - usually google 24hrs only returned links
24 hrs old, seems a bit broken now
for proxies to toss on my s/box thread
listing google - last 24 hrs -- and it was returning links for
2011-2012-2013 - usually google 24hrs only returned links
24 hrs old, seems a bit broken now
- Jan 25, 2009
- 6,378
- 3,774
Haha, thanks!
The short answer is no. The longer answer is maybe. Meaning I don't really see what your doing there. I mean I don't see how thats any different then the standard google search. Im sure it is, but I know most of the google string and it looks basic. What am I missing there, how is it different?
Choose save report and then send it to scrapeboxhelp (at} gmail [com)
Also try to reinstall the addon first.
Its fine, just purchase it and then email
support (at} scrapebox [dot) com
and give them the email address that you purchased with and then also the email address that the license is under and they will get you set.
It seems fine for me. Whats the keywords/footprints you were using specifically and Ill try and duplicate it. Were you using the standard harvester or the custom harvester?
If it was in the middle of when penguine 2.1 was rolling out google could have just been glitchy (just thinking out loud). Let me know the terms and also if it was google.com or google.co.uk etc...
fab145
Junior Member
- Dec 13, 2008
- 160
- 54
Hi loopline,
Breakdown of Google search parameters used in this query "http://www.google.com/search?complete=0&output=ie&hl=en&q={KEYWORD}&filter=0&nfpr=1&ncr=1&num=100&start={PAGENUM}"
complete=0 --> Turn auto-suggest and Google Instant on (=1) or off (=0)
hl=en --> Language settings passed down by your browser, here English
filter=0 --> Include omitted results
nfpr=1 --> Turn off auto-correction of spelling
ncr=1 --> No country redirect: Allows you to set the Google country engine you would like to use despite your current geographic location. Though it works best if no Google cookie has been set yet.
Source: http://www.rankpanel.com/blog/google-search-parameters/
I do not care about any of the parameters except "nfpr=1".
For some reason, I want to scrape results for the keyword I search, NOT auto-corrected results that Google gives by default. That's why I want to use "nfpr=1" parameter.
For example, let's search wrong spelling of whatsapp (wahtsapp)
When "nfpr=1" parameter is NOT used (by default this, parameter is not used by Google), Google gives results for "whatsapp" instead of "wahtsapp" --> http://www.google.com/search?complete=0&output=ie&hl=en&q=wahtsapp&filter=0&ncr=1&num=10&start=0
When "nfpr-1" parameter is used, Google does not auto-correct spelling and gives results for "wahtsapp" --> http://www.google.com/search?comple...wahtsapp&filter=0&nfpr=1&ncr=1&num=10&start=0
I wrote a Google scraper in python using Scrapy. But since I'm a biginner, this scraper is having a lot of bugs, it takes me forever to fix them.
If somehow I'm able to use "nfpr-1" parameter in ScrapeBox, my problem will be solved.
I would also like "filter=0" parameter to be utilized in SB if this is not already being used. I don't know if this parameter is already being used in SB.
"filter=0" will avoid situation like this: http://i.imgur.com/uCuIaFP.png and will scrape maximum results possible.
Thanks
christianbed
Elite Member
- Aug 17, 2011
- 1,588
- 1,012
Having trouble with the blog analyzer...it keeps crashing 'an error occurred in the application'...I have uninstalled and reinstalled it, but getting the same error report. Any ideas?
softtouch2009
Senior Member
- Dec 2, 2009
- 1,064
- 257
Did you submit the error report? When it crash, there should be a popup asking you to submit the report.
If you did not, there should be a file "bugreport.txt", email this to support.
christianbed
Elite Member
- Aug 17, 2011
- 1,588
- 1,012
Yep...did that last night.
UPDATE: Just checked with my other computer, which is also running another scrapebox license, and it works just fine. :-/ Guessing that I'll have to dig into my firewall to see if it is blocking the addon.
UPDATE: Just checked with my other computer, which is also running another scrapebox license, and it works just fine. :-/ Guessing that I'll have to dig into my firewall to see if it is blocking the addon.
Last edited:
dikkill
Power Member
- Jul 27, 2011
- 560
- 127
Regarding on this tutorial you made http://www.youtube.com/watch?v=Ri6cci288vk
How do i configure scrapebox to update public proxies on the fly?
How do i configure scrapebox to update public proxies on the fly?
EymardSiojo
Newbie
- Sep 24, 2013
- 33
- 5
I mistakenly erased the bugreport txt in my file. Arg!
Please help. Can you please share your bug report..
Please help. Can you please share your bug report..
- Jan 25, 2009
- 6,378
- 3,774
I mistakenly erased the bugreport txt in my file. Arg!
Please help. Can you please share your bug report..
No no. The bugreport is created only when you have a crash and its only specific to you. You don't want someone elses, that would cause issues. Its not big deal that you deleted it, if your instance crashes again it will create a new one.
You would want to use the custom harvester, I have a video here:
http://www.youtube.com/watch?v=SwaLo10ck9U
Make sure that you don't just send in the error report with the send option that pops up. You would want to click save or close and it will create a bugreport.txt file in your addons folder which is inside your scrapebox directory. Then send that report to
scrapeboxhelp (at} gmail [dot} com
or
support (at} scrapebox {dot} com
If you go to settings at the top, is custom harvester or multi threaded harvester ticked off, or both?
Its working fine for me, but if custom harvester is ticked off, the timespan element would have to be setup differently.
Ok, I understand specifically what you are trying to do. With the multi threaded or single threaded harvester the nfpr-1 is Not used, and there is no way to make it used, you can only do that in the custom harvester.
The filter=0 is utilized, scrapebox scrapes omitted results by default.
The best thing I can say is to use the custom harvester, and use private proxies set to very low connections and then go into the custom harvester settings and max out the proxy retries. What this will do is retry the keyword if a proxy fails. If using private proxies, even on a low proxy retry, they are so reliable that you would not likley have many if any not completed keywords. If you upped the proxy retries to like 20 then you would probably have no uncompleted keywords.
Basically I wouldn't approach it as, "how can I make this work and export uncompleted keywords" I would approach it as "how can I use the custom harvester and make sure all keywords complete so Im not spending extra time chasing uncompleted keywords".
I have a video on how to harvest safely with private proxies:
http://www.youtube.com/watch?v=Ri6cci288vk
Alternatively if you have to use public proxies just max out the proxy retries. That might make the scrape take longer but ultimately its less time then loading them back in and doing it over and over.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~~~~
Tips and Tricks 2
[video=youtube_share;xQPHLjuNeuY]http://youtu.be/xQPHLjuNeuY[/video]
[video=youtube_share;xQPHLjuNeuY]http://youtu.be/xQPHLjuNeuY[/video]
Last edited:
- Jan 25, 2009
- 6,378
- 3,774
Make sure you Close Down the rank tracker. If its open the scheduler will not run, it has to be closed and then it runs.
I can't get it to mess up. How deep in the urls did you go to get those? I mean are you harvesting 100 results or 10 or 500 or?
I just tried again and its working. Can you skype me some pages that you are getting back that are old?
Yes, you harvest from Facebook the same way you harvest from any thing else. I have 2 videos that cover email grabbing:
http://www.youtube.com/watch?v=uWwpE9cn_ME
and part of this video:
http://www.youtube.com/watch?v=xQPHLjuNeuY
(which by the way, I posted just 3 posts above yours)
You should go here and watch:
http://www.youtube.com/user/looplinescrapebox/videos
LakeForest
Supreme Member
- Nov 11, 2009
- 1,268
- 1,816
Just liked to say you're all great
- Status