Is there any software out there (free/trial versions preferred, but feel free to list ones that cost money), that will collect all the post urls of a blog and leave out categories, tag pages, and other pages that aren't actual posts? Edit: I've been using scrapebox with the site:url but it includes posts, tags, categories, author pages, pages, and a ton of stuff I don't want and I have to go through deleting them manually. If it were for a small one or two blogs this would be fine, but I've got a ton that I need to do.
You actually already have the best tool for the job, you just need a few more operators in your search. If it is a blog with the date in the post pages (www.blog.com/2010/06/blog-title) then this will work for collection ONLY blog post URLs: site:blog.com AND /*/*/ (the AND must be capitalized) You see, google will treat the asterisks as wildcards and the use of an all uppercase AND means that google can only return results to you that meet both of your requirements. If the blogs in question don't use dates in their permalink structure, just find the common denominator of the URLs that you don't want and put them after the operator -inurl:thing you don't want returned Example: site:blog.com -inurl:tag -inurlage -inurl:wp-content -inurl:rss -inurl:feed -inurl:category See what I'm saying? Google "boolean operators" (without quotes) to learn some more interesting things you can make Google do for you when searching.
Thanks, that will save me a ton of time! I'll try it out. And I thought I was good with Google and search engines
