1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to get all backlinks pointing to multiple URLs

Discussion in 'Black Hat SEO' started by domainmadness, Jan 1, 2016.

  1. domainmadness

    domainmadness Senior Member

    Joined:
    Jun 22, 2011
    Messages:
    1,107
    Likes Received:
    350
    Do you know any tool/service, that can take a huge list of urls and get list of all backlinks pointing to those urls? Of course this can be done one by one using any backlink checker tool, but if you have a big list of domains you need to get backlinks it takes way too much time.
     
  2. domainmadness

    domainmadness Senior Member

    Joined:
    Jun 22, 2011
    Messages:
    1,107
    Likes Received:
    350
    Surely someone knows a tool or service that can do this?
     
  3. key23

    key23 Newbie

    Joined:
    Mar 28, 2009
    Messages:
    9
    Likes Received:
    2
    Majestic offers bulk backlink checker up to 100,000 urls at a time.
     
  4. clevelandslim

    clevelandslim Jr. VIP Jr. VIP

    Joined:
    Nov 15, 2008
    Messages:
    1,856
    Likes Received:
    188
    Majestic is one of the best backlink checker tool
     
  5. DMoon95

    DMoon95 Registered Member

    Joined:
    Oct 12, 2015
    Messages:
    58
    Likes Received:
    5
    i've tested majestic and a few other backlink checker tools and all of them shows just some of the backlinks, not even one of them shows all the backlinks.
     
  6. HoneyHelper

    HoneyHelper Supreme Member

    Joined:
    Jun 29, 2015
    Messages:
    1,474
    Likes Received:
    388
    HTML:
    http://smallseotools.com/backlink-checker/
    Try this!
     
  7. accelerator_dd

    accelerator_dd Jr. VIP Jr. VIP

    Joined:
    May 14, 2010
    Messages:
    2,448
    Likes Received:
    1,009
    Occupation:
    SEO
    Location:
    IM Wonderland
    For what you want to do, you can use a plugin called 404 to 301. However, I would not recommend it as it can be a huge footprint.

    Instead you can create pages for each of those links and redirect the old URLs to the new URLs.
     
  8. domainmadness

    domainmadness Senior Member

    Joined:
    Jun 22, 2011
    Messages:
    1,107
    Likes Received:
    350
    What are you talking about?

    As far as I know Majestic only offers STATS of your url list, not each and every backlink pointing to each and every url on your list? If I'm wrong and you can get majestic to list the URLs, could you please point out how it's done?

    Try what? It allows me to enter only 1 url so it's not really suitable for going through a huge list...
     
  9. domainmadness

    domainmadness Senior Member

    Joined:
    Jun 22, 2011
    Messages:
    1,107
    Likes Received:
    350
    Any other suggestions how to get list of all the backlinks pointing to list of URLs?
     
  10. ConsultJoseph

    ConsultJoseph Jr. VIP Jr. VIP

    Joined:
    Apr 25, 2014
    Messages:
    282
    Likes Received:
    68
    Gender:
    Male
    Location:
    Pearl of the Orient Seas
    I am assuming you need to make a spintax out of all the URLs in order to point randomly to them? Play with the different options here since this might help: Get Spintax
     
  11. accelerator_dd

    accelerator_dd Jr. VIP Jr. VIP

    Joined:
    May 14, 2010
    Messages:
    2,448
    Likes Received:
    1,009
    Occupation:
    SEO
    Location:
    IM Wonderland
    My bad - I just realized I replied in this thread after reading another one.

    How big of a list are we talking? I dont think there are any web based apps that can do that, but i coded an app some time ago that was doing that with majestic.
     
  12. domainmadness

    domainmadness Senior Member

    Joined:
    Jun 22, 2011
    Messages:
    1,107
    Likes Received:
    350
    I'm not a native English speaker, but is my English THAT bad or why nobody seem to get what I'm trying to find! No, I'm not trying to make spintax...

    Not huge lists, but few thousands. Custom coded app might be only way to go. You're not selling/sharing that app by any chance?
     
  13. berkay1907

    berkay1907 Senior Member

    Joined:
    Mar 25, 2012
    Messages:
    1,127
    Likes Received:
    617
    Majestic can only be used to see the backlinks count etc. If you want to download the backlinks you need to create reports and it costs lots of credits for example if a site has 20K backlinks. There was a tool for this but it is closed now. Maybe ahrefs???

    Ok i just checked Majestic. It takes about 2-3 mins to get 1 report about backlinks. And if the site has 20K backlinks it will be about 1% of your monthly credits. So you can get backlinks of 100 sites like this and spent about 4-5 hours total. You can get 15 days majestic accounts from fiverr i guess. But i don't know if they will give account credits on those trial accounts. My account is member account.
     
    Last edited: Jan 8, 2016
  14. Jack Torrance

    Jack Torrance Power Member

    Joined:
    Oct 18, 2014
    Messages:
    541
    Likes Received:
    163
    Are you checking multiple URLs originating from the same domain name, or numerous URLs spanning various domains? If it's a single domain you're checking then you can use "Root" on Majestic instead of searching links by "URL". This would grab all of the URLs the domain has links to, which is likely not what you want... But, perhaps if you then export the full list as an Excel/text file there is some kind of program which can match content from a second file against a first and remove lines which have no match (or only keep lines which have a match). Sort of like how on Scrapebox you can filter out URLs by "Containing" or "Not Containing". I know there are things out there with this functionality but I don't remember as I've never had a use for such things.

    Also, just out of pure curiosity, what purpose do you want this function for?
     
  15. shadow2015

    shadow2015 Junior Member

    Joined:
    Jan 17, 2015
    Messages:
    112
    Likes Received:
    14
    Occupation:
    L2 Security Engineer (Network)
    Location:
    London UK
    Maybe, only maybe this is what you are looking for, if not...accept my apologies
    Xenu
     
  16. asap1

    asap1 BANNED BANNED Jr. VIP

    Joined:
    Mar 25, 2013
    Messages:
    4,961
    Likes Received:
    3,179
    Majestic does what you want.

    You can download a backlink report if you have a subscription, if you look of fiverr you can get a group account for $5 for 15 days or $10 for 30 days.

    Ahrefs does the same thing and most likely has more urls since its a faster crawler than majestic.
     
  17. domainmadness

    domainmadness Senior Member

    Joined:
    Jun 22, 2011
    Messages:
    1,107
    Likes Received:
    350
    So if I have 5000 URLs it takes about 500 hours, so if I work 8 hours/day (- breaks so 7 hours) so it would take me a bit over 2 months to go over the list... And that's just one list. Any other great ideas?

    URL lists consist multiple domains of course so your solution doesn't really help. There can be plenty of reasons to use this function. One would be to gather all the possible link sources your competitors have. Other would be to find expired domains. Or boost TIER links of your network. Just use your imagination.

    No problem, but I just don't get how you think XENU would help me? It doesn't give you any backlinks, it's just crawls all the pages of one domain...

    I've been using Majestic almost daily last few years and no it doesn't (I'm happy if you proof me wrong). You can download backlink report for 1 domain, but not for 5000.
     
  18. rob1977

    rob1977 Power Member

    Joined:
    Mar 25, 2013
    Messages:
    775
    Likes Received:
    676
    Manual research would be the normal answer but you are right 5000 urls is a bit much to manually build a url profile for each.

    The only thing I can think of would be to code a tool, or have one coded for you. That could multithread the research and then scrape the results into what ever format is usable for you (so text if you were planning to import it straight into a posting tool)
     
  19. NosokOrg

    NosokOrg Junior Member

    Joined:
    Jun 21, 2015
    Messages:
    139
    Likes Received:
    15
    you can try ahrefs, but if you need immediate reports, you can scrap sources and find links by domain, if you need it is constantly - I advise A-Parser, very powerful soft, but you need to learn regular expressions in case to use it on many domains. Also they provide paid support - 10$-15$ per task ( per source), but sure, if you need many sources it is expensive.
     
  20. SECONDS

    SECONDS Junior Member

    Joined:
    Dec 31, 2015
    Messages:
    141
    Likes Received:
    11
    Scrapebox can do that..