Recent content by weedsmoker

A little nitpicking about thread title and contents, arrays are not exactly the same as the lists in Python, for most tasks lists are better suited, but arrays (which are more useful in specific cases and are located in array module) are closer to "C" arrays and all elements of the array must be...

Same as you, using API when it's possible, lib for generating user agents (you can find a few of them easily), requests lib mostly for scrapping, and automating browser for other tasks where heavy js scripting is involved.

Maybe it's not enough to focus element, maybe site also checks for keypresses or hover events, like google and fb do for example. Probably you need to send native key presses to focused field, or send synthetisized keypress events if you're working with headless browsers (it can get tricky).

AFAIK G follows js links/redirects, I'm not sure G will treat your website as link farm, but I'm pretty sure that quality of those 3rd party sites will influence your ranking.

Hi, token is just some text string you have in your spintax that needs to be replaced with some other text after spining. For example if you have some url but you don't wont to hard code it in spintax because your code is replacing it with urls from some list of urls or some random url, you...

I just gave it a quick glance, so maybe I'm wrong, there is some js generated token value which is needed for logging. FB was bitch before because of too much js, so I used only fb mobile version for http requests, I assume situation now is probably worse, maybe try logging in through their...

No, no, I didn't make myself clear. I mean just executing javascript for example on 411.com page: document.querySelector("#who").value = "YOUR SEARCH TERM"; then firing off click() event on search button to execute search. I think selenium has evaluate method for executing javascript code. I...

Checked whitepages, same shit as 411 :p, no problemo :), also without sending keys, just changing input's value attribute and clicking search button with javascript click() method. Google tracks mouse movements and key presses, it's obvious in their source code, they don't allow to easily screw...

I think selenium simulate key presses ("send keys") as javascript synthesized key press events. You'll need proper focus/blur and optionally (click/hover) events associated with this key presses to simulate native behavior. I never had much luck with that on some sites (google or facebook for...

I've used python sendkeysctype lib, it's python bindings for sending native key events: https://msdn.microsoft.com/en-us/library/ms646310%28v=vs.85%29.aspx There are bindings for other languages as far as I know, but don't know if there is java one. Maybe calling directly user32.dll or...

Got same issue with webdriver/selenium and google. Something's off with selenium's default profile, also send keys is not good, focus, move, hover events are not proper. I use win32 sendkeys for that. So I used customized ff to reduce browser footprint, running it from vm, and controlling it...

I didn't had much luck with selenium, also it's pretty slow. Something like Firefox + Mozrepl suited me better (or Marionette). Easy to customize, communicates through sockets, you write client in any language you want, and customize Mozrepl by your needs. Selenium was also bitch to use with vpn...

It would be nice if you shared your solution :-), meanwhile I'll share mine. For some ADSL modems there is possibility of shell access. Then you can control modem to do some things like reset/renew ip address. Soft/hard reset usually takes some time, but you can quickly renew ip address within a...

Python example: import requests import json import time headers = { 'content-type': 'application/json', 'User-Agent': 'Mozilla/5.0 (Windows NT 5.1; rv:18.0) Gecko/20140101 Firefox/30.0' } access_token = 'YOUR ACCESS TOKEN' profile_ids = '''100000111992548 100000111992548...

If you don't mind programming, check Goose, I'm using it with python, it's simple and works nice https://github.com/grangier/python-goose