1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

i need to do this with imacros or gsa spider

Discussion in 'BlackHat Lounge' started by ehinoze, Oct 18, 2012.

  1. ehinoze

    ehinoze Power Member

    Joined:
    Feb 1, 2011
    Messages:
    674
    Likes Received:
    106
    Occupation:
    Internet marketing
    Location:
    London
    i have a long list if tinyurl kind of sites links.
    that is sites that are shortened with url shorteners, some bit.ly etc
    i need to get the original url of each one of them on a list as well

    so can i use imacros or gsa web spider (i have pro for each)to load and get the end url of each tinyurl?
    pf yes, how?

    of course i will really appreciate any heads up on how to do this.
     
  2. Soomro

    Soomro BANNED BANNED

    Joined:
    Sep 26, 2012
    Messages:
    33
    Likes Received:
    12
    Hi ehinoze,


    iMacro is built for such kind of redundant tasks; try out following firefox bot - it will open every link from csv file (tinyurl_list.csv) and get its real url and save it back to another file named (tinyurl_output.csv):


    VERSION BUILD=7601015 RECORDER=FX
    TAB T=1

    set !timeout_page 3
    cmdline !datasource tinyurl_list.csv
    set !datasource_columns 1
    set !loop 2
    set !datasource_line {{!loop}}

    url goto={{!col1}}

    wait seconds=1
    set !var1 {{!urlcurrent}}
    add !extract {{!col1}}
    add !extract {{!var1}}

    saveas type=extract folder=* file=tinyurl_output.csv

    I hope you are aware of iMacro prior of using this code and know where to put input file and where to get output file!
     
    • Thanks Thanks x 1
  3. ehinoze

    ehinoze Power Member

    Joined:
    Feb 1, 2011
    Messages:
    674
    Likes Received:
    106
    Occupation:
    Internet marketing
    Location:
    London
    hmm this isnt working.I cant get it to work
     
  4. ehinoze

    ehinoze Power Member

    Joined:
    Feb 1, 2011
    Messages:
    674
    Likes Received:
    106
    Occupation:
    Internet marketing
    Location:
    London
    RuntimeError: Page loading timeout, line 10 (Error code: -802)

    Thats the error message
     
    Last edited: May 1, 2013