Hrefer Not Collecting Links

tabish8612

Power Member

Sep 13, 2009

551

130

• Apr 23, 2010

• #1

Anyone can face the the same problems as I am facing. When I am searching phrase in Hrefer it does not collect links and when I click one of the Query in hrefer it open up firefox page with links in it. But it does not collect links. Any one can have the solution to this. below are the screenshots of my hrefer

 

B

boffmaster

Junior Member

Jun 1, 2009

144

32

• Apr 24, 2010

• #2

You may have better luck if you set up the engine.php script on your own server and then insert it into the field marked "URL to checker script" as seen in your picture. Look in the help file....

 

D

dzoniij

Regular Member

May 24, 2009

469

114

• Apr 24, 2010

• #3

try without proxy if hrefer collects links normally then something wrong with your proxies

 

tabish8612

Power Member

Sep 13, 2009

551

130

• Apr 24, 2010
• Thread Starter Thread Starter

• #4

@boffmaster: I dont have any server to install engine.php script. What to do next
@dzoniij: I tried it but still no luck

 

B

BSON

Junior Member

May 6, 2007

191

282

• Apr 24, 2010

• #5

Google Yandex Bing Yahoo which of them you are trying to scrape?

 

tabish8612

Power Member

Sep 13, 2009

551

130

• Apr 24, 2010
• Thread Starter Thread Starter

• #6

BSON said:

Google Yandex Bing Yahoo which of them you are trying to scrape?

Click to expand...

I am trying with google but seem to be not collecting in any of the search engine

 

D

dzoniij

Regular Member

May 24, 2009

469

114

• Apr 24, 2010

• #7

tabish8612 said:

@boffmaster: I dont have any server to install engine.php script. What to do next
@dzoniij: I tried it but still no luck

Click to expand...

maybe google blocked you temporarily? Reinstall hrefer again it should work good.

 

TheWicker

Senior Member

May 15, 2008

810

270

• Apr 24, 2010

• #8

I have the same issue bro. Some day it just stopped working. It doesn't work whether I use private proxies, public proxies or no proxy at all. It just sits there.

I'm scraping the results with other scrapers (like scrapebox) for the past month. Everything works fine there.

 

P

prattchad

Registered Member

May 29, 2009

56

25

• Apr 24, 2010

• #9

i have the same problem if i load a huge list of keywords anything bigger they 100,000 keywords then it wont scrape try a smaller keyword list that might fix it

 

TheWicker

Senior Member

May 15, 2008

810

270

• Apr 24, 2010

• #10

Nah it's not that. I've tried it with as low as 1000. It always worked then one day it stopped. I personally haven't changed anything. My proxies are working (as seen on other scrapers), so I too am puzzled why this happens.

 

3

3kaday

Regular Member

Apr 28, 2009

218

53

• May 20, 2010

• #11

I've got the same problem. Hrefer won't gather links with or without proxies

 

CasinoJack

BANNED

Jan 17, 2009

683

1,432

• May 20, 2010

• #12

Have you guys seen the update? i think this was covered already but, here you go again

Assuming you mean google go to the engines.ini file and use this instead

Code:

[Google]
Hostname=http://[GOOGLEHOST]
Query=search?as_q=[QUERY]&num=100&hl=en&output=ie
LinksMask=<a title="[...]href=[LINK]>
TotalPages=10
NextPage=</nobr><hr><center><a href=[LINK] target=_self>
NextPage2=</a>  <a href=[LINK] target=_self>

 

P

prattchad

Registered Member

May 29, 2009

56

25

• May 20, 2010

• #13

CasinoJack said:

Have you guys seen the update? i think this was covered already but, here you go again

Assuming you mean google go to the engines.ini file and use this instead

Code:

[Google]
Hostname=http://[GOOGLEHOST]
Query=search?as_q=[QUERY]&num=100&hl=en&output=ie
LinksMask=<a title="[...]href=[LINK]>
TotalPages=10
NextPage=</nobr><hr><center><a href=[LINK] target=_self>
NextPage2=</a>  <a href=[LINK] target=_self>

Click to expand...

glade i found this hrefer is now harvesting again with this update Thanks

 

R

reinie

Elite Member

Jan 16, 2009

1,576

1,046

• Aug 8, 2010

• #14

I tried this with no luck.

Any other suggestions?
thanks

 

ash1ey

Regular Member

Jul 21, 2006

427

216

• Aug 8, 2010

• #15

I would be interested in the updated engines.ini if anyone has it also. Xrumer support is so slow and I cant access there forums at the minute.

 

R

reinie

Elite Member

Jan 16, 2009

1,576

1,046

• Aug 8, 2010

• #16

I wonder when the new versions will be released...

Is there other people that are also having issues with this right now?

 

R

reinie

Elite Member

Jan 16, 2009

1,576

1,046

• Aug 8, 2010

• #17

brandnew said:

very sad

Click to expand...

what does that mean?

 

R

reinie

Elite Member

Jan 16, 2009

1,576

1,046

• Aug 9, 2010

• #18

Here is the right fix:

Code:

Hostname=http://www.google.com
Query=search?q=[QUERY]&num=100&hl=en
LinksMask=<li class=g><h3 class=[...]><a href="[LINK]" class=l
TotalPages=10
NextPage=</a><td class=b><a href="[LINK]" class=pn style="text-align:left">
NextPage2=</a><td class=b><a href="[LINK]" class=pn style="text-align:left">

 

Last edited: Aug 9, 2010

R

reinie

Elite Member

Jan 16, 2009

1,576

1,046

• Aug 9, 2010

• #19

I found it in the exrumer forum:

"The problem with Hrefer is the url it uses to scrape. It uses 'google.com/ie?{query data}' where as scrape box uses 'google.com/search?{query data}'.

I have noticed that if you query the 'ie' version with 'inurl' google will automatically flag the IP. This isn't permanent but can take hours to be unflagged."