gscraper question
- Thread starter proxygo
- Start date
whiteblackseo
Elite Member
- Apr 11, 2015
- 2,995
- 1,162
Did a quick scrape, nope. Must be just you.
dekadent30
Elite Member
- Nov 10, 2008
- 1,910
- 1,036
I have 0 urls scraped for 2 days, i think developer should update gscraper
- Aug 7, 2011
- 1,575
- 1,430
Its problem with google guys. Same thing happened last year around november as far as i remember.
Problems depends on location - for some guys in middle europe Gscraper works, for some in USA not.
Version 1.2.6.2 is working but LPM is low.
Problems depends on location - for some guys in middle europe Gscraper works, for some in USA not.
Version 1.2.6.2 is working but LPM is low.
- Nov 2, 2008
- 58,920
- 26,528
gscraper was working fine til friday not last november
0 urls in last 24hrs not 6 months
anyone else getting 0 urls email support [email protected]
v 1.2.9.0
0 urls in last 24hrs not 6 months
anyone else getting 0 urls email support [email protected]
v 1.2.9.0
- Aug 7, 2011
- 1,575
- 1,430
Yes gscraper was working fine till friday but same thing happened in november (and everything was fine after few days without changing Gscraper version).
Its not problem with Gscraper, its problem with google. I have clients who dont have problems on version 1.2.8.5, others (including me) have problems with this version. Only difference is server location.
It should not be too hard to fix this section of code:
Code:
public static string smethod_0(string string_0, int int_0, IWebProxy iwebProxy_0)
{
string result = "--";
string text = Class14.smethod_5(string_0);
string_0 = HttpUtility.UrlEncode(string_0);
string text2 = "http://toolbarqueries.google.com.hk";
string string_ = string.Concat(new string[]
{
text2,
"/tbr?client=navclient-auto&ie=UTF-8&ch=",
text,
"&features=Rank&q=info:",
string_0
});The question is does the will exist by the author? Does patience run out first?
Hawke, people paid you good money for the program, and pay you good money for your proxy service. Fix the program or remove the protection and release the source.
Last edited:
Bullshit! I just updated to 1.2.9.1 entered %KW% as the footprint, entered house and mouse as keywords. Zero URL's were scraped with just tested proxies through GScraper.
Now it seems to be working. You are putting the keyword into the remark field.
- Nov 2, 2008
- 58,920
- 26,528
running a scrape now, and hawk ty for email replys 2 days ago
and justus, ill say this, stop being a dick.
i emailed hawk as soon as the problem started 2 days ago, he replied
in 24hrs, which is the same time frame i give my own subs for a reply 24hrs
2 days its fixed. hes done his job hes fixed it. so be a good chap and stop
being a dick.
update took a list of gscraper proxies that went out to my subs today
proxy tester working fine - scraping working fine
and justus, ill say this, stop being a dick.
i emailed hawk as soon as the problem started 2 days ago, he replied
in 24hrs, which is the same time frame i give my own subs for a reply 24hrs
2 days its fixed. hes done his job hes fixed it. so be a good chap and stop
being a dick.
update took a list of gscraper proxies that went out to my subs today
proxy tester working fine - scraping working fine
Last edited:
Proxygo, if I wanted to be a dick I would release his source code. I have not. I really do not expect a lot, I just expect the program to operate. For scraping the first ten pages I have my own scraper and it uses pretty much the same methods as GScraper, which is pretty much boiler plate. My own code is this:
Code:
if (count != 0)
{
IP = this.listViewProxy.Items[index].SubItems[1].Text;
Port = Convert.ToInt32(this.listViewProxy.Items[index].SubItems[2].Text);
HttpWebRequest webRequest = (HttpWebRequest)WebRequest.Create(requestUriString);
WebProxy proxy = new WebProxy(IP, Port);
webRequest.Timeout = this.timeout;
webRequest.Proxy = proxy;
webRequest.UserAgent = usrAgent;
WebResponse response = webRequest.GetResponse();
Stream responseStream = response.GetResponseStream();
StreamReader streamReader = new StreamReader(responseStream);
text = streamReader.ReadToEnd();
str = "http://" + response.ResponseUri.Host.ToString();
str2 = "http://" + response.ResponseUri.Host.ToString() + "/";
}I had told Hawke that I would not release his source code and my honor means a lot to me.
Now my own scraper did not fail. Based on this and the fact that I can change to any Google server in the world, I can make an assumption that the failure was not Google changing anything.
Knowing the code, I pretty much know where the problem was. Think as you may. What probably happened when I made the second post about it not working is that I beat Hawke making the changes to his server that decrypts the information.
Last edited:
Have to love you English folk. You use language that no American generally would. Shows a difference in culture when I have to look something as basic to you as the word Pram to understand that you meant a baby carriage. Now if a closely related language is different enough to send one to the Oxford and Cambridge Dictionary to find the meaning, that the cultures might also be as different?
So nice to see that you understand that.