Recent content by Liddells Doll

  1. Liddells Doll

    How can I avoid being detected as a bot?

    Despite of what most people believe, most companies don't use "AI algorithms" to detect bots. The "algorithms" are usually hard-coded heuristics like the time between actions, HTTP headers, or fingerprinting. Pinpoint exactly what are their systems detecting and correct it. This should work for...
  2. Liddells Doll

    Machine Learning for Adult Tube Sites

    You usually don't want to increase the complexity of the model or add more features unless you are completely sure that what you have *works*, and the model is not complex enough to capture the relationships you want. Before even selecting a model, you have to define your metricsーyes, "your"...
  3. Liddells Doll

    Built IPv6 Proxy Multiplexer - One IPv4 VPS → Thousands of Unique IPv6 Endpoints

    This is basically NAT. The main issue with your idea is that HTTP is a little slow and possibly overkill for your use-case. Oh, and if you bind a port for each proxy endpoint you will have a hard limit of 65535 concurrent connections.
  4. Liddells Doll

    A search engine for my country.

    In principle, you need an indexed database, a crawler, and a ranking algorithm to sort the links based on the user's query. You can make a simple search engine for <10 concurrent users with basic Python knowledge.
  5. Liddells Doll

    Which languages booking.com, priceline, hotels.com, expedia.com used and for which purposes?

    >Are there any tools to detect that which languages they used for which parts? Probably. But you can also check if they posted any job offers on linkedin or in the website itself, if they grow in size they will probably hire more developers trained in the stack they are using. If that fails...
  6. Liddells Doll

    IPV6 Proxy with python

    I'm not sure if adding these command line arguments does anything. I don't see them in --help, at least. >stackoverflow.com SLASH questions SLASH 38304253 SLASH how-to-set-proxy-authentication-user-password-using-python-selenium This is what worked for me for ipv4. It should be the same for ipv6.
  7. Liddells Doll

    ASK me anything about python

    How do I implement a monad in Python?
  8. Liddells Doll

    I've been learning python for a month and can understand most of the code i see on github.

    Switch after 2-3 years to C or another low-level lang. After you feel comfortable with both you will be able to do pretty much whatever you want with a computer.
  9. Liddells Doll

    Github scraping LI script

    Some issues mention errors and the repository is not being maintained so you will have to fix it if you want to use it.
  10. Liddells Doll

    Scraping with python issue

    Websites should have a robots.txt file that states what resources can be scraped by bots among other things. https://www.google.com/robots.txt https://en.wikipedia.org/robots.txt
  11. Liddells Doll

    API's for hotelsites

    >booking.com Inspecting the network with the dev tools of your browser you can find the API >https://www.booking.com/dml/graphql They use graphQL. Pretty annoying to work with in my experience but if you mimic the queries (inspect the network for this too) you can build your automation tools.
Back
Top