uditbhansali
Regular Member
- Aug 16, 2010
- 488
- 292
I think there's some problem with the proxy server. It harvested 30K proxies and only 80 live proxies found?
What's the problem?
What's the problem?
Some things I would suggest to make it better:
1) Highlight which proxy type we chose either through an underline or check mark next to the proxy type list. Currently, no way to know.
2) Option of crawling of ONLY the proxy URL list specified in the config and turning off leechlist.
3) Find an IP. Create a feature to let us search for a IP within the proxy list panel.
Question:
1) Is there a way to run PM using a proxy? Don't want to piss off my ISP.
2) Why is PM going to a leechlist that falls outside the list specified in the config fetch URL? I would prefer this to be an option, rather than the rule. To test, I cleared the proxy fetching URL list. Stored only the HMA urls and attempted to crawl only the HMA pages and bring in only those scraped proxies. PM goes out to a leech list and pulls in proxies from them instead. I don't want that. I want the ability to control the URLs that PM crawls. So how does one force the crawler to scrape **ONLY** proxies in the config proxy URL list?
Has this been done yet?
JRim:
I've seen this shit come up twice (see image below). This happens when launching PM fresh and getting new proxies. This domain/url is shipped with your product.
Are you aware of this? I've since removed that url out of my proxy URL list and suggest you check and ship proxy website URLs that have been tested regularly. That kind of thing could fuck things up for everyone.
If you try going to that URL directly, it shows that it is dead AND it tries an exploit.
noticed a problem on my windows server 2008 and win7 64 bit , when I start the program it asks for update , it then is stuck with waiting behind the waiting for program to close option in the update manager . I then closed the program using my task manager , second time it updated fine on both systems. Just something weird that I noticed and thought I would let you know
I think there's some problem with the proxy server. It harvested 30K proxies and only 80 live proxies found?
What's the problem?
the program needs a way to auto delete all old proxies, 'get proxies', test proxies, then automatically export those proxies to a text file every X minutes.
Another idea I think would make the program better.
When using automation, after scanning the old proxies and going below the threshold of working proxies I think it would be good to have it use a random proxy from the working list to search for new ones instead of always using the same or first one.
Not sure if this is already being done but seems to me that if a random working one is used, it would normally find new/different lists to scan.
Another nice feature would be;
When it is using proxies in the list to find other proxies to have the option to have it only search for pages/proxies posted within a certain time frame.
For instance when I look for proxy lists manually I don't really want to scrape proxies from a list that was posted over a year ago because 99% of those will be dead and I'd just be wasting my time by even scanning that list.
So what I do is narrow my search down to lists posted in the last week or less.
Granted I don't find as many proxy lists this way but I always find more working proxies by doing this.
Below is a screenshot in case anyone isn't following what I'm suggesting here.
![]()
kickapooh you are right and this is a great feature indeed. If I rember well.. GSA Search Engine Ranker have in its own proxy scrapper a function like this.. to search only in a given time frame.
Also I think there shold be done some cleaning in proxies list. Coz the program starts fine find new proxies but after checking 10000 mostof them are dead and barely find working ones. So is obvious there are some outdated lists outhere that do not bring any proxies just old dead ones that only add up junk to the list and consume time.
I think the key is to find the most lucrative proxy lists and get rid of old outdated ones.
Also I'm wondering is there a function to be able to upload 2 lists instead of one?! I want to upload on FTP a list with annonimty proxies and another one with Google friendly one.
This software seems like a life saver for many.
Noob question - i need proxies for youtube activities, my guess is that i do need G-enabled proxies, right? Do they need to be elite or anonymus, HTTP or socks? Can someone be kind and explain me what proxies will work for YT to save me some precious time?
Thanks
(zoom in with browser to see details)View attachment 12033 (zoom in with browser to see details)
JRim: Are you going to fix this or not? As far as I am concerned this is a pain in the ass. Your tool is delivering crap proxies outside what the user specifies. The list is clearly empty and PM is bringing in these leech lists to pull info to front the result list.
The maximum proxie limit specified in the config should be a ceiling, not an obligation to fill the queue with the number specified in that config parameter. In other words, the urls specified in the fetch list dictate what should be returned. You should not intermingle going outside that list unless the user requests it. I would suggest putting in a checkbox to allow us to control this called "fetch outside this list".
This is like me going to a search engine to search for "dog collars" and I set the result set to Max at 1000 items. The search engine gives me 500. Then, you go out (without my approval) and fetch 500 items of more garbage and include in the result. Give me the results *I* want, not what you want to give me.
Besides, the leech list you are using can become stale. We don't get to modify this list because you are bringing it in by default on every run. If the items in this crappy leech list don't get updated often, the processing time takes even longer searching the same crap list every run. Don't force your user to have to do this and waste CPU processing time. Make this alternative list an option. Better yet, don't even use it. Let your users choose and fill in the fetch list themselves.
I scraped 150,000 proxies too. Gave me 386 anonymous proxies which is pretty disappointing.
Then, strangely, kept going for another 150,000 and still 386 anonymous proxies. So 300,000 tested and 386 proxies. Took me about 4 hours. Damn...
Can't someone find some better starting sources so that we don't get so many dead proxies?
I've been testing Proxy Multiply and the results are less than pleasing. Out of 1.5 million ip addresses, I found one that was fast and consistently passed the test in scrabebox.
While I like the software so far I never got a response from you and my trial has ended. Just lost a sale bro. Customer support and frequency of updates are what I look for before buying software. I know you guys have your hands full but they don't have to all be implemented at the same time. Take it one update at a time, release it and start on the next.Any idea on when this next release will be out? I only have a couple days left on my trial and would like to see if the "filter out certain ports" option is going to work well enough for me to buy it?
You're telling me you are too lazy to do 5 minutes of coding to put in a checkbox option to turn search engine leeching off?
Look, this feature is NOT working. You are generating totally crap proxies and wasting everyone's time. Already your users are telling you that this strategy does not work. Out of 100,000+ proxies we are getting less than 400. That is a 0.4% success rate. Its even worse after we test the proxies. Less than 1/2 of them are of any use factoring in that every else is vying for those proxies. So we are left with a 0.2% success rate for 5 fucking hours of processing.
We shouldn't have to deal with this by default.
Every person who does not use a port scanner to generate their own list, leeches off every one else's public list. If you don't keep that leech list fresh, you are just handing us more shit proxies and wasting our time. It is more work for you keeping that list fresh, and your users are going to continue to hit this thread with complaints.
Your leech urls should be a suggestion, not a requirement.
Also don't forget that we are risking our ISP accounts here. By processing more shit proxies, we are increasing our time on the pipe and taking on more risk from getting our accounts banned.
If you aren't producing at least a 5% success rate on 100,000 proxies, you need a better strategy.
Whats even more questionable, is after you are done processing, your View url box asks us if we want to save the leech list that is generating 99% of crap. Why even ask that if we are forced to use it anyway.
Put in a checkbox and let us turn this on/off. Leave it on by default if that is what you want. But for the rest of us who don't want to waste our time, let us have the choice to turn it off.
While I like the software so far I never got a response from you and my trial has ended. Just lost a sale bro. Customer support and frequency of updates are what I look for before buying software. I know you guys have your hands full but they don't have to all be implemented at the same time. Take it one update at a time, release it and start on the next.
It's a great idea, searching for ip numbers to find more ip numbers...You might find me 50 proxies that pass your test, but when I test them with scrapebox, they all fail. And your automated feature doesn't seem to save files or send emails either.