Discussion in 'BlackHat Lounge' started by GoGetRanked, Feb 2, 2014.
Would love to hear from other site owners regards,ToG
I have... their bots are hammering my sites!
I'm seeing a lot of referrals from this site lately.
I am seeing the same thing ..wtf are they guys upto
i also get traffic from this site, they think they are doing this so we visit them
we look at our stats and see that we get traffic from them, so what we do is visit their site,
this way they get traffic and new customers i think
Could someone tell me what this site is all about?
I would also like to know!
Did a little research on this and found an article about it at onlinethreatalerts. Just do a search for "what is the website semalt about" Can't post links yet apparently.
This seemed like the best results I could find. Everything else was just other people asking what the heck it is.
Based on the info provided at that link I agree with it but who knows, it could be useful. I think I'll be all right without it. In regards to why they are pinging everyone is beyond me.
Go to the site?
A Semalt crawler is a technical bot of the webmaster analytics tool Semalt.com. According to the software algorithm Semalt crawler bots visit website and gather statistical data for our service simulating real user behavior: unique IP, browser, display resolution etc. This information is used exclusively within the Semalt.com project and isn't revealed to a third party. Our crawler bots have 100% bounce rate and don't click on advertising banners (cpc, cpa, cpm systems) or extend links. No need to look for some hidden motive or conspiracy when your website was visited by our crawler as it was mentioned above. All the visits are automatic and random.
You can remove your website from their list:
Don't add your sites to their list using that PHP form. You don't know what they'll do with that information. Take a look at all the crap they are getting on their Facebook page (hilarious):
Personally haven't been bombed by their crawler, about 23 times last month on a site that gets 2 million visitors a month, but not having the crawler identify itself as a bot is just bad business practice, hope none of the BHW members are part of this as you are going out of business pretty soon
They're most likely doing big data crawling and analysis. Nothing to scare you except for the bandwidth and the bounce rate that could affect your rankings if you have small traffic volumes.
You can block them using htaccess and if you wanna have some fun you can redirect the bots back to their site, also via htaccess, to increase their bandwidth a little, I reckon they won't feel it tho. People got hyped about this because of indignation I suppose, they can't control what semalt is doing and that can frustrate them I guess.
Perfectly legal but kind of immoral. Anyway, would like to take a peek at the data they've collected so far, I'm getting into big data and smart data (actionable insights) myself. Fun stuff if you like statistics and trend patterns.
Anyway to block them from my server? If you have 1 site htaccess seems like the way to go, but if you have multiple sites a way to keep them off the server completely would be better.
This is the htaccess code I use to lock them out. (Kambasoft also belongs to them).
Thank's for nice share.
I used this opt-out and haven't had anything from them since. It's still pretty scummy of them to do this in the first place.
that sums it up. years ago i've seen some trick like this here, but i forget the name of it.
so simply by using this trick the site in 13 months, 'achieves' a DA of 71, and alexa us rank 7400.
Separate names with a comma.