iMacros proxies and useragents question

Scorpion Ghost

Scorpion Ghost

Elite Member
Executive VIP
Jr. VIP
Joined
Mar 22, 2013
Messages
9,148
Reaction score
10,489
I would like to know, is it possible to have an iMacro switch to a random Useragent and Proxy (from lists I will specify) with every reload?

So, for example.

set useragent (random from my list)
set proxy (random from my list)
go to URL
wait seconds=?

loop...


Is that possible? Also, if possible to clear cache and cookies would be nice, although I could just set firefox to not save any cache or cookies. And also, if it's possible, where can I get a nice up-to-date useragents list?

Thanks
 
Advertise on BHW
agents are not the problem. there is like 5 top agents which everyone uses. but yeah you need start each session with new profile
 
uncce said:
agents are not the problem. there is like 5 top agents which everyone uses. but yeah you need start each session with new profile
Click to expand...

What do you mean start each session with a new profile?
 
just pick a big enough user agent list if you want random and make it into a csv
same for the proxies, specify the csv as datasource and run the macro in loop
you can use the "CLEAR" command to clear cookies

but if you want to play with randomizing, you need something like this: SET !VAR1 EVAL ("Math.floor(Math.random()*100 + 1);")

or random line picking in a csv courtesy of gogetta: http://www.blackhatworld.com/blackh...x-plugin-run-every-2-minutes.html#post1047600

anyway, you can find the basic stuff in the imacros wiki, more advanced stuff on stackoverflow or here too
 
Thanks HoNeYBiRD.

Tell me, is there a place I can download a user agent list with the most common ones? I go through various sites googling about it and it's all so vague. Way too many user agents and stuff and I get lost.

And another thing, can the referrer also be set using iMacros? So...

clear (cookies)
set proxy: 111.111.111 (random picked from list)
set user agent: firefox (random picked from list)
set referrer: facebook or whatever (random picked from list)
url goto: some link
wait seconds=?

loop...

repeat...


That's pretty much what I wanna do.
 
Last edited:
Scorpion Ghost said:
Thanks HoNeYBiRD.

Tell me, is there a place I can download a user agent list with the most common ones? I go through various sites googling about it and it's all so vague. Way too many user agents and stuff and I get lost.

And another thing, can the referrer also be set using iMacros? So...

clear (cookies)
set proxy: 111.111.111 (random picked from list)
set user agent: firefox (random picked from list)
set referrer: firefox (random picked from list)
url goto: some link
wait seconds=?

loop...

repeat...


That's pretty much what I wanna do.
Click to expand...
most common user agents as of Aug 2015:
HTML: 
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_4) AppleWebKit/600.7.12 (KHTML, like Gecko) Version/8.0.7 Safari/600.7.12
Mozilla/5.0 (Windows NT 6.1; WOW64; rv:39.0) Gecko/20100101 Firefox/39.0
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.125 Safari/537.36
Mozilla/5.0 (Windows NT 6.3; WOW64; rv:39.0) Gecko/20100101 Firefox/39.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:39.0) Gecko/20100101 Firefox/39.0
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.130 Safari/537.36
Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36
Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.107 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.125 Safari/537.36
Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:39.0) Gecko/20100101 Firefox/39.0
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.132 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.130 Safari/537.36
Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.125 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.107 Safari/537.36
Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.107 Safari/537.36
Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.132 Safari/537.36
Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.130 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.89 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.132 Safari/537.36
Mozilla/5.0 (Windows NT 6.1; rv:39.0) Gecko/20100101 Firefox/39.0
Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/600.6.3 (KHTML, like Gecko) Version/8.0.6 Safari/600.6.3
Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; rv:11.0) like Gecko
Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:39.0) Gecko/20100101 Firefox/39.0
Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.130 Safari/537.36
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.89 Safari/537.36
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.135 Safari/537.36 Edge/12.10240
Mozilla/5.0 (iPad; CPU OS 8_4 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Version/8.0 Mobile/12H143 Safari/600.1.4
Mozilla/5.0 (Windows NT 5.1; rv:39.0) Gecko/20100101 Firefox/39.0
Mozilla/5.0 (Windows NT 6.1; WOW64; rv:38.0) Gecko/20100101 Firefox/38.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.132 Safari/537.36
Mozilla/5.0 (Windows NT 10.0; WOW64; rv:39.0) Gecko/20100101 Firefox/39.0
Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.125 Safari/537.36
Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.125 Safari/537.36
Mozilla/5.0 (X11; Linux x86_64; rv:39.0) Gecko/20100101 Firefox/39.0
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.130 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/600.7.12 (KHTML, like Gecko) Version/7.1.7 Safari/537.85.16
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/43.0.2357.130 Chrome/43.0.2357.130 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36
Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.130 Safari/537.36
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.125 Safari/537.36
Mozilla/5.0 (Windows NT 6.1; Trident/7.0; rv:11.0) like Gecko
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.125 Safari/537.36
Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.1; WOW64; Trident/6.0)
Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0)
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/600.5.17 (KHTML, like Gecko) Version/8.0.5 Safari/600.5.17
Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.132 Safari/537.36
Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.107 Safari/537.36
Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.89 Safari/537.36
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.132 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.125 Safari/537.36
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.89 Safari/537.36
Mozilla/5.0 (iPad; CPU OS 8_3 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Version/8.0 Mobile/12F69 Safari/600.1.4
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36
Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Firefox/38.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.132 Safari/537.36
Mozilla/5.0 (Windows NT 6.2; WOW64; rv:39.0) Gecko/20100101 Firefox/39.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.107 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.89 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.130 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:39.0) Gecko/20100101 Firefox/39.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.130 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11) AppleWebKit/601.1.37 (KHTML, like Gecko) Version/9.0 Safari/601.1.37
Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.130 Safari/537.36
Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:38.0) Gecko/20100101 Firefox/38.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_5) AppleWebKit/537.78.2 (KHTML, like Gecko) Version/6.1.6 Safari/537.78.2
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.130 Safari/537.36
Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Firefox/31.0 Iceweasel/31.8.0
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.130 Safari/537.36
Mozilla/5.0 (X11; Ubuntu; Linux i686; rv:39.0) Gecko/20100101 Firefox/39.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_2) AppleWebKit/600.3.18 (KHTML, like Gecko) Version/8.0.3 Safari/600.3.18
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/600.6.3 (KHTML, like Gecko) Version/7.1.6 Safari/537.85.15
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.107 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11) AppleWebKit/601.1.39 (KHTML, like Gecko) Version/9.0 Safari/601.1.39
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.107 Safari/537.36
Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Firefox/31.0
Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36
Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; Touch; rv:11.0) like Gecko
Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.0; Trident/5.0;  Trident/5.0)
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.130 Safari/537.36
Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:39.0) Gecko/20100101 Firefox/39.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.132 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.125 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_6_8) AppleWebKit/534.59.10 (KHTML, like Gecko) Version/5.1.9 Safari/534.59.10
Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:38.0) Gecko/20100101 Firefox/38.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.89 Safari/537.36
Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.124 Safari/537.36

not sure about the referer faking, there's no built-in solution for that for sure
try to incorporate this into the macro maybe: http://referer.us/Spoof-HTTP-Referer.html
or input the GOTO urls with a hiderefer/fakerefer prefix, like http://nullrefer.com/?http://google.com
 
Awesome. I'll get to working on making my iMacro now.

This is the first time I'll be working with csv files actually. Tell me, are these correctly formatted?

User Agents:
123.PNG

Proxies:
56464.PNG

Like, for the proxies for example, maybe the second part of the proxy needs to go on column B? Right now it's all under column A as it is. Are the above correct/will work?
 
Scorpion Ghost said:
Awesome. I'll get to working on making my iMacro now.

This is the first time I'll be working with csv files actually. Tell me, are these correctly formatted?

User Agents:
View attachment 68902

Proxies:
View attachment 68903

Like, for the proxies for example, maybe the second part of the proxy needs to go on column B? Right now it's all under column A as it is. Are the above correct/will work?
Click to expand...
it would be better, if everything would be in one csv
put the ip addresses in column A, the ports in column B and the user agents in column C, so you can specify only one source
 
Thanks man.

I worked on this last night. Two reasons, one to learn how to use proxies and datasources in iMacros, and the reason I wanted to make this is to make a Dailymotion view macro - now that the dailymotion bot doesn't work anymore.

The problem I encountered and that I cannot get around are proxies. I want to use free proxies, but they will never get the job done. Maybe there's a way to get high quality free proxies which could get the job done, but I don't know how...

I managed to get the csv working and tested by sending my proxy to the whatsmyip site, and indeed it would pick up the proxy and change it with every loop. But when I tried sending the iMacro to a dailymotion video, it would never load. Then I tried various different proxy lists from BHW, from elsewhere online, that I scrape myself with some bot I have, and none would ever really work... unfortunately.
 
Scorpion Ghost said:
Thanks man.

I worked on this last night. Two reasons, one to learn how to use proxies and datasources in iMacros, and the reason I wanted to make this is to make a Dailymotion view macro - now that the dailymotion bot doesn't work anymore.

The problem I encountered and that I cannot get around are proxies. I want to use free proxies, but they will never get the job done. Maybe there's a way to get high quality free proxies which could get the job done, but I don't know how...

I managed to get the csv working and tested by sending my proxy to the whatsmyip site, and indeed it would pick up the proxy and change it with every loop. But when I tried sending the iMacro to a dailymotion video, it would never load. Then I tried various different proxy lists from BHW, from elsewhere online, that I scrape myself with some bot I have, and none would ever really work... unfortunately.
Click to expand...
yes, that's because those are public proxies you're using, they are unreliable, sometimes they work, in the next second/minute/hour they don't, mostly they're also slow

now why they don't work on dailymotion i wouldn't know, but i have the feeling that most of those are already blocked there (because they're free and abused to hell), so even if they work elsewhere, they won't work on dailymotion and/or they're really slow, while loading an ip lookup site doesn't take too much bandwidth, it takes a lot more to load a dailymotion page with videos, especially if you start a video and i guess that's what you're tyring to do
i would go even further, if you have a tested, fresh list of public proxies, let's say not more than a day old, there's almost no point in testing, because once you finished the testing you can almost start from the beginning again, that's how unreliable they are, especially if it's a long list and takes long to test
 
HoNeYBiRD said:
yes, that's because those are public proxies you're using, they are unreliable, sometimes they work, in the next second/minute/hour they don't, mostly they're also slow

now why they don't work on dailymotion i wouldn't know, but i have the feeling that most of those are already blocked there (because they're free and abused to hell), so even if they work elsewhere, they won't work on dailymotion and/or they're really slow, while loading an ip lookup site doesn't take too much bandwidth, it takes a lot more to load a dailymotion page with videos, especially if you start a video and i guess that's what you're tyring to do
i would go even further, if you have a tested, fresh list of public proxies, let's say not more than a day old, there's almost no point in testing, because once you finished the testing you can almost start from the beginning again, that's how unreliable they are, especially if it's a long list and takes long to test
Click to expand...

It's not that they don't work. I mean, the page loads, but the video 80% of the times never even plays. 20% of the times it plays, but keeps getting stuck and stuff. And when it does play, it takes it like 2-5 minutes to actually load and play... so that's not gonna work for shit!

So basically from your post I get the impression that free proxies would never do the job, even if I knew how to scrape fresh high quality fast proxies.

Well, that's where this attempt for an iMacro ends. If I ever get into that proxy shit, I guess a little money could get me proxies that are better, and then I can make the iMacro. But for now, I can't continue...
 
Scorpion Ghost said:
It's not that they don't work. I mean, the page loads, but the video 80% of the times never even plays. 20% of the times it plays, but keeps getting stuck and stuff. And when it does play, it takes it like 2-5 minutes to actually load and play... so that's not gonna work for shit!

So basically from your post I get the impression that free proxies would never do the job, even if I knew how to scrape fresh high quality fast proxies.

Well, that's where this attempt for an iMacro ends. If I ever get into that proxy shit, I guess a little money could get me proxies that are better, and then I can make the iMacro. But for now, I can't continue...
Click to expand...


Hi dude

I was basically looking for such a macro script (not for dailymotion btw). I wondered if you would be down for a partnership let's say I buy a couple of private / shared proxies, let you use them and you share your script we me. It would benefit both of us since we share our results, what do you think ?
 
Last edited:
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top