why ahrefs doesn't count tumbrl links as BL?

[eral123]

when I search my full links of my domain I can see some of my tumblrs that I used as backlinks for that site . But when I check ahref the tumblrs aren't there. Why?

 

[Rock_Shock]

bookmarked

 

[BassTrackerBoats]

Maybe tumblr blocks ahrefs?

 

[dbanjo]

ahrefs needs to crawl them, for unpopular pages that could take a while.

 

[Narend]

when I search my full links of my domain I can see some of my tumblrs that I used as backlinks for that site . But when I check ahref the tumblrs aren't there. Why?

how did you put your link there ?

I believe if we put the BL inside the article post it won't count as BL coz tumblr redirect it , check BassTrackerBoats video
blackhatworld.com/seo/using-tumblrs-to-get-backlinks-my-worst-video-ever-by-far.843506/

 

[bartosimpsonio]

Maybe tumblr rewrites links out for bots? Check this, there is a rule for link_to blocked: https://www.tumblr.com/robots.txt

 

[Narend]

Maybe tumblr rewrites links out for bots? Check this, there is a rule for link_to blocked: https://www.tumblr.com/robots.txt

thank you for that tumblr txt

is this

"Disallow: /link_to"

mean that link to outside the tumblr is a No...No ?

 

[thebat1980]

Can you manually submit the site to Google to help?

 

[Reg Park]

Same here, seems like some BL checkers displays tumblr sites but when it comes to very high authority tools like ahrefs, it doesn't show

 

[bartosimpsonio]

thank you for that tumblr txt

is this

"Disallow: /link_to"

mean that link to outside the tumblr is a No...No ?

If tumblr somehow rewrites links out with that then yes. Gotta look in google's cache to see.

 

[nahid133]

Can you manually submit the site to Google to help?

Google count Tumblr as backlinks no issue.
Just follow BassTrackerBoats instruction for tumblr BL.
It doesn't matter if ahrefs doesn't count it as BL

 

[rafark]

I wonder what's ahrefs' rationale for using "ahrefsbot" user agent when they can identify themselves as a regular user or as Google in order to avoid getting blocked and thus get more data for their clients. I just can't understand them.

 

[dbanjo]

I wonder what's ahrefs' rationale for using "ahrefsbot" user agent when they can identify themselves as a regular user or as Google in order to avoid getting blocked and thus get more data for their clients. I just can't understand them.

Massive negative press, it's a moral issue, people would know, and voices would get raised.

 

[rafark]

Massive negative press, it's a moral issue, people would know, and voices would get raised.

Why? What is it morally bad about it? They're scraping websites anyway.

 

[dbanjo]

Why? What is it morally bad about it? They're scraping websites anyway.

Plenty of people don't want their website scraped. If an option to block it wasn't offered, people start to get very vocal. Happened to majestic back when they started. Every seo wanted to block it and made that pretty clear to the company.

 

[rafark]

Plenty of people don't want their website scraped. If an option to block it wasn't offered, people start to get very vocal. Happened to majestic back when they started. Every seo wanted to block it and made that pretty clear to the company.

But then again, if they identify themselves as a general user (Mozila 5.0*) website owners would never know they're being scraped.

 

[dbanjo]

But then again, if they identify themselves as a general user (Mozila 5.0*) website owners would never know they're being scraped.

They would when they visit ahrefs and pull down all the data on their site. Bit of a giveaway that.

 

[rafark]

They would when they visit ahrefs and pull down all the data on their site. Bit of a giveaway that.

The thing is, I don't get why they'd be like "they're scraping me", so what? Their website is publicly available on the Internet. As far as I know, partially storing and using their data for commercial purposes is not ilegal because they're not treating it as theirs, but as a reference to the original owner (the sites).

What's the worst thing that could happen? Getting a negative impact on their brand image? I bet that'd never happen because all SEO tools would be affected and seo agencies still need the tools.

 

[dbanjo]

Back on planet earth lots of people don't want their link data catalogued for the seo world to see. The only way to see that data, is via these back link tools.

I can assure you they don't reveal the user agent string and honour robots text out of the kindness of their fucking heart.

They do it because people want to block them, and if they didn't allow it, people would complain. It's that simple.

 

[Brian Alexander]

The thing is, I don't get why they'd be like "they're scraping me", so what? Their website is publicly available on the Internet. As far as I know, partially storing and using their data for commercial purposes is not ilegal because they're not treating it as theirs, but as a reference to the original owner (the sites).

What's the worst thing that could happen? Getting a negative impact on their brand image? I bet that'd never happen because all SEO tools would be affected and seo agencies still need the tools.

Because there's a difference between running your imacros bot from your basement and managing the crawler of an internationally recognized company such as Ahrefs that visits billions of pages.