Searching for Tool scanning for https mixed content issues or broken images

W

waltersweb

Registered Member
Joined
Sep 25, 2012
Messages
93
Reaction score
15
Hi guys,
I am trying to find a tool which does (kind of) the following:
- Lets me paste in a list of URLS
- Checks all of those URLS for https mixed content issues and/or broken images

Anybody has an idea if such a tool exists? Maybe a scrapebox addon I am not aware of?

Thanks!!
 
Advertise on BHW
seosdl said:
Ctrl + shift + j in chrome...
Click to expand...
Thanks SEOSDL, I know that that is the way to do it manually but I am talking about checking 100-1000+ URLS. Sorry for not pointng that out
 
jesseyor said:
urlschecker, you can find it on google
Click to expand...
Thanks! That is a nice tool :) However it will only get the status code by loading the header which won't detect mixed content/broken images
 
EDIT,
Realized you are looking for something very different. Only 3rd option will work for you.
You will need to load the page, make a list of image on the page, try opening images in list with "http request", record the response and save broken images to a file.

Option 1, I think you can do this with http://www.scrapebox.com
Option 2,
import urllib2
urls_check=open("Image_url_File", "r")
for url in urls_check:
try:
connection = urllib2.urlopen(url)
print connection.getcode()
connection.close()
except urllib2.HTTPError, e:
print e.getcode()​

just save the response in another text file with urls.

Option 3, https://bablosoft.com/shop/BrowserAutomationStudio
Shouldn't take you much time to figure this tool out. You will need to use "http" requests.
 
sagarmadan said:
Option 2,
import urllib2
urls_check=open("Image_url_File", "r")
for url in urls_check:
try:
connection = urllib2.urlopen(url)
print connection.getcode()
connection.close()
except urllib2.HTTPError, e:
print e.getcode()​
just save the response in another text file with urls.
Click to expand...

Thanks man! Sorry to ask that question :) but what type of code is this/how do I execute it? JS?
 
waltersweb said:
Thanks man! Sorry to ask that question :) but what type of code is this/how do I execute it? JS?
Click to expand...
It's python, but this will only work if you have url(s) for images. "https://domain.com/image.png"
if you feed it image url(s). It will visit them and check for response. Broken/not found will respond with a 404.
But I assume you want to feed it url(s) with multimedia content on them and you want the bot to find images on that page and then check if they are broken.
For this you will need to add a few more lines of code to it. If you can't code, you should go with "option 3"

I think screaming frog will actually do the job but the output interface will not be the best for your task.
I suggest going with "browser automation studio"
 
waltersweb said:
Hi guys,
I am trying to find a tool which does (kind of) the following:
- Lets me paste in a list of URLS
- Checks all of those URLS for https mixed content issues and/or broken images

Anybody has an idea if such a tool exists? Maybe a scrapebox addon I am not aware of?

Thanks!!
Click to expand...
The broken links checker could check for broken links, but not for mixed content issues. In scrapebox I mean.
 
waltersweb said:
It is not possible to load it up with multiple domains right? You have to check one by one?
Click to expand...
You can load up as many urls/domains as you want. Although bear in mind if you have it set to crawl thru the site, then loading more then 1000 at a time might get resource intensive. I mean the 64bit version could support tens of thousands loaded at once, but you would need some serious memory to work with massive lists.
 
loopline said:
You can load up as many urls/domains as you want. Although bear in mind if you have it set to crawl thru the site, then loading more then 1000 at a time might get resource intensive. I mean the 64bit version could support tens of thousands loaded at once, but you would need some serious memory to work with massive lists.
Click to expand...
With website auditor? Sorry I only have the free version yet and you can only paste in one url. But that changes when you go pro?
With free you have to manually add one by one (unless I am completely blind..)
 
waltersweb said:
With website auditor? Sorry I only have the free version yet and you can only paste in one url. But that changes when you go pro?
With free you have to manually add one by one (unless I am completely blind..)
Click to expand...
Sorry, I was on a different page then you. I was talking about Scrapebox.
 
waltersweb said:
Both good tools, but you can't load Bulk URLS right? Or am I missing that feature?
Click to expand...
You can load the links manually or you can use a spider to crawl full site what you have to do is increase memory. by default it will be 512 but if you are harvesting large site more than 1lac pages than you have to increase it.
 
Are the URLs from the same website? Or do you just need to bulk import a list of URLs and have them checked?

If either of those - you can try TechSEO360 - it also supports command line so you can schedule it to run through multiple websites if need to be.
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top