1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Can IMacros scrape data from a webpage

Discussion in 'Black Hat SEO Tools' started by Rhianni32, Aug 18, 2009.

  1. Rhianni32

    Rhianni32 Junior Member

    Joined:
    May 6, 2009
    Messages:
    162
    Likes Received:
    31
    Location:
    Colorado, US
    Question for any Imacros users....

    I've played around and watched the tutorial videos which have been a great help. However I am not seeing a way to use the free firefox add-on to collect data off of a webpage.
    That option appears to only be in the scripting edition which is $500. On the other hand it appears if you understand the coding language then perhaps you can just type it out yourself.

    Has anyone been able to collect data with any of the free versions?
     
  2. justone

    justone Elite Member

    Joined:
    Oct 12, 2008
    Messages:
    1,516
    Likes Received:
    1,037
    Occupation:
    -
    Location:
    Europe
    imacros supports the "SAVEAS" command to store something.
    you can store it in various formats, as well as the !EXTRACT variable

    both together should make it possible.
    But maybe invest a few hours and learn php basics, it's better for scraping !
     
  3. olm75

    olm75 Power Member

    Joined:
    Jan 14, 2009
    Messages:
    746
    Likes Received:
    82
    does imacros have the ability to extract info from a file on local computer.... and then save in a VAR1...
     
  4. olm75

    olm75 Power Member

    Joined:
    Jan 14, 2009
    Messages:
    746
    Likes Received:
    82
    can imacros extract content from lets say a txt file and then save it in a VAR1 then post from imacros iim file...
     
  5. Rhianni32

    Rhianni32 Junior Member

    Joined:
    May 6, 2009
    Messages:
    162
    Likes Received:
    31
    Location:
    Colorado, US
    Olm75: Yes it can. It pulls info from .csv spreadsheet files.

    justone: Thanks for that info. Their wiki is really nice and extensive so i should be able to find the info i need from what you listed.
    I might grab some books and tackle some PHP in the future.
     
  6. olm75

    olm75 Power Member

    Joined:
    Jan 14, 2009
    Messages:
    746
    Likes Received:
    82
    ok i figured this out already but now i am stuck on some of these button scrapes, when i do it manually and then record but when i play the macro it says that button is not found...
     
  7. justone

    justone Elite Member

    Joined:
    Oct 12, 2008
    Messages:
    1,516
    Likes Received:
    1,037
    Occupation:
    -
    Location:
    Europe
    Hi olm, there are multiple ways to specify how imacros should search a button/element.
    So if the default does not work, try another !
    You need to read their documentation well, there is no way around that.
     
  8. olm75

    olm75 Power Member

    Joined:
    Jan 14, 2009
    Messages:
    746
    Likes Received:
    82
    lol wow thanks for the knowledge, i have read it all...
     
  9. mrwho

    mrwho Junior Member

    Joined:
    Apr 3, 2008
    Messages:
    122
    Likes Received:
    39
    is the extracted data comin up blank or is it the actual button that is coming up "not found"
    You can add this line to the top of your macro: SET !ERRORIGNORE YES and see if the macro will run properly...If that doesn't work you may have to post the code and site so we can try and help you better
     
  10. olm75

    olm75 Power Member

    Joined:
    Jan 14, 2009
    Messages:
    746
    Likes Received:
    82
    here is the code i have so far for Hubpages.com:

     
    Last edited: Aug 19, 2009
  11. mrwho

    mrwho Junior Member

    Joined:
    Apr 3, 2008
    Messages:
    122
    Likes Received:
    39
    Add this before the last line of your code and then it should work:
    TAG POS=1 TYPE=INPUT:SUBMIT FORM=ID:tNT ATTR=ID:temp

    So your code should look like this now
    Also delete the space between pass and : so you dont get a wrong format error
     
    Last edited: Aug 21, 2009
  12. olm75

    olm75 Power Member

    Joined:
    Jan 14, 2009
    Messages:
    746
    Likes Received:
    82
    what does this line mean... TAG POS=1 TYPE=INPUT:SUBMIT FORM=ID:tNT ATTR=ID:temp
     
  13. mrwho

    mrwho Junior Member

    Joined:
    Apr 3, 2008
    Messages:
    122
    Likes Received:
    39
    It's the last button on that page before the continue button shows up...at least that's what I got when I went through the code...It submits the page to go on to the next page or it submits the page then waits on the continue button to show up.
     
  14. olm75

    olm75 Power Member

    Joined:
    Jan 14, 2009
    Messages:
    746
    Likes Received:
    82
    nope doesnt work for me
    is it better to switch the click mode in iMacros
     
  15. mrwho

    mrwho Junior Member

    Joined:
    Apr 3, 2008
    Messages:
    122
    Likes Received:
    39
    yea just switch the click mode during recording and see if that works...If it doesn't you may have to add a wildcard somewhere
     
  16. olm75

    olm75 Power Member

    Joined:
    Jan 14, 2009
    Messages:
    746
    Likes Received:
    82
    nope didnt work i dont think the position is relative to the screen because it changes
     
  17. olm75

    olm75 Power Member

    Joined:
    Jan 14, 2009
    Messages:
    746
    Likes Received:
    82
    anyone geting an error in imacros with firefox...
    RuntimeError: Unable to select entry specified by: __undefined__, line