1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Simple Script Needed - to visit webpages

Discussion in 'Hire a Freelancer' started by cdn_craigs, Oct 29, 2015.

  1. cdn_craigs

    cdn_craigs Jr. VIP Jr. VIP

    Joined:
    Jul 16, 2011
    Messages:
    1,399
    Likes Received:
    390
    Occupation:
    PAY PER CALL GURU at your service...
    Location:
    Canada
    Home Page:
    hi guys
    I have 40 webpages i need a script/bot to visit everyday.. what is available? or can i get someone to write one for me.
     
  2. nocare

    nocare Junior Member

    Joined:
    Apr 29, 2013
    Messages:
    164
    Likes Received:
    81
    Location:
    Deep Code
    DarcyRipper should be good to just grab the entire pages.
    As far as extracting specific data from all 40, a custom scraper running on a cron job should do the trick pretty simply.
    Might be a bit of work depending on difference of pages and desired content from each, as well as how scraped content will be stored.

    ScrapeBox might be able to do this as well, but I don't know a lot about it.

    Cheers
     
  3. BeanDH92

    BeanDH92 Regular Member

    Joined:
    Nov 24, 2013
    Messages:
    301
    Likes Received:
    36
    Occupation:
    Web developer
    how much is your budget?
    I can write a bot visit each site for you run on your browser
     
  4. Buzzika

    Buzzika Jr. VIP Jr. VIP

    Joined:
    Jul 8, 2009
    Messages:
    1,161
    Likes Received:
    1,428
    Occupation:
    Hustler
    Location:
    Gurgaon
    Home Page:
    I could code up something like this for free. Throw me a link from some of your high PR sites in exchange and I would be happy :)
    PS. The bot will use a normal browser to completely mimic human behavior. I would be using selenium + firefox/chrome for it.