hey
I have 1000+ URLs that I want to scrape to retrieve the title info from. After trying different things, I ultimately used iMacros scripts, which I don't know anything about. Nonetheless, I managed to make a script after reading guides.
My script is working perfectly but has few problem and have some queries
My Script:
what i want to ask is this
1- do i have to use SET !TIMEOUT_STEP 1, SET !ERRORIGNORE YES, SET !EXTRAC
EST_POPUP NO for every URL or using these cmds on top only once will do?
2- even with SET !EXTRACEST_POPUP NO i get this error once
in the begining, how to remove that??
3- out of many URLs i have a few that are dead so imacros wait till 60s before going to next url.. how to cut down the time to 10s for dead or non responding URLs?
<-- how to make it 10s limit
4- the script i made is for 1 url. now how can i multiple this script 1000+ times all with different urls that i have in a specific txt file. so either it makes this same script for all the urls or it auto leeches urls from a txt file while leeching like when first url is leeched it finds the next url from url txt file and auto inserts into this script so it can run all my urls and at the end i have results of all my urls
5- the final result i get is
http_google.co m,Google
how can i change is "," after URL to a tab or a double space so my results look something like this
http_google.co m Google
kindly reply to all my queries and if possible redo my script so i would know where to put which code
P.S sorry if my post wasnt understandable enuf because i wasnt allowed to post links so i have to delete and redo alot of text
i have also posted my post here for better visual
dpaste.co m/3XG9N9T.txt (remove the space)
i know its nothing but im willing to give a VPN acc of good duration to the helper who can fix my problems
thanks!
I have 1000+ URLs that I want to scrape to retrieve the title info from. After trying different things, I ultimately used iMacros scripts, which I don't know anything about. Nonetheless, I managed to make a script after reading guides.
My script is working perfectly but has few problem and have some queries
My Script:
Code:
[COLOR=#000000]VERSION BUILD[/COLOR][COLOR=#000000]=[/COLOR][COLOR=#800000]9002379[/COLOR][COLOR=#000000]
TAB T[/COLOR][COLOR=#000000]=[/COLOR][COLOR=#800000]1[/COLOR][COLOR=#000000]
TAB CLOSEALLOTHERS
SET [/COLOR][COLOR=#000000]![/COLOR][COLOR=#000000]TIMEOUT_STEP [/COLOR][COLOR=#800000]1[/COLOR][COLOR=#000000]
SET [/COLOR][COLOR=#000000]![/COLOR][COLOR=#000000]ERRORIGNORE YES
SET [/COLOR][COLOR=#000000]![/COLOR][COLOR=#000000]EXTRACT_TEST_POPUP NO
URL GOTO[/COLOR][COLOR=#000000]=[U]url link[/U][/COLOR][COLOR=#000000]
ADD [/COLOR][COLOR=#000000]![/COLOR][COLOR=#000000]EXTRACT [/COLOR][COLOR=#000000]{{![/COLOR][COLOR=#000000]URLCURRENT[/COLOR][COLOR=#000000]}}[/COLOR][COLOR=#000000]
TAG POS[/COLOR][COLOR=#000000]=[/COLOR][COLOR=#800000]1[/COLOR][COLOR=#000000] TYPE[/COLOR][COLOR=#000000]=[/COLOR][COLOR=#000000]TITLE ATTR[/COLOR][COLOR=#000000]=*[/COLOR][COLOR=#000000] EXTRACT[/COLOR][COLOR=#000000]=[/COLOR][COLOR=#000000]TXT
SAVEAS TYPE[/COLOR][COLOR=#000000]=[/COLOR][COLOR=#000000]EXTRACT FOLDER[/COLOR][COLOR=#000000]=[/COLOR][COLOR=#000000]d[/COLOR][COLOR=#000000]:/[/COLOR][COLOR=#000000] FILE[/COLOR][COLOR=#000000]=[/COLOR][COLOR=#000000]links[/COLOR][COLOR=#000000].[/COLOR][COLOR=#000000]txt
WAIT SECONDS[/COLOR][COLOR=#000000]=[/COLOR][COLOR=#800000]1[/COLOR][COLOR=#000000]
SET [/COLOR][COLOR=#000000]![/COLOR][COLOR=#000000]TIMEOUT_STEP [/COLOR][COLOR=#800000]1[/COLOR][COLOR=#000000]
SET [/COLOR][COLOR=#000000]![/COLOR][COLOR=#000000]ERRORIGNORE YES
SET [/COLOR][COLOR=#000000]![/COLOR][COLOR=#000000]EXTRACT_TEST_POPUP NO
URL GOTO[/COLOR][COLOR=#000000]=[U]url link[/U][/COLOR][COLOR=#000000]
ADD [/COLOR][COLOR=#000000]![/COLOR][COLOR=#000000]EXTRACT [/COLOR][COLOR=#000000]{{![/COLOR][COLOR=#000000]URLCURRENT[/COLOR][COLOR=#000000]}}[/COLOR][COLOR=#000000]
TAG POS[/COLOR][COLOR=#000000]=[/COLOR][COLOR=#800000]1[/COLOR][COLOR=#000000] TYPE[/COLOR][COLOR=#000000]=[/COLOR][COLOR=#000000]TITLE ATTR[/COLOR][COLOR=#000000]=*[/COLOR][COLOR=#000000] EXTRACT[/COLOR][COLOR=#000000]=[/COLOR][COLOR=#000000]TXT
SAVEAS TYPE[/COLOR][COLOR=#000000]=[/COLOR][COLOR=#000000]EXTRACT FOLDER[/COLOR][COLOR=#000000]=[/COLOR][COLOR=#000000]d[/COLOR][COLOR=#000000]:/[/COLOR][COLOR=#000000] FILE[/COLOR][COLOR=#000000]=[/COLOR][COLOR=#000000]links[/COLOR][COLOR=#000000].[/COLOR][COLOR=#000000]txt[/COLOR]what i want to ask is this
1- do i have to use SET !TIMEOUT_STEP 1, SET !ERRORIGNORE YES, SET !EXTRAC
EST_POPUP NO for every URL or using these cmds on top only once will do?2- even with SET !EXTRAC
EST_POPUP NO i get this error once
in the begining, how to remove that??3- out of many URLs i have a few that are dead so imacros wait till 60s before going to next url.. how to cut down the time to 10s for dead or non responding URLs?
<-- how to make it 10s limit4- the script i made is for 1 url. now how can i multiple this script 1000+ times all with different urls that i have in a specific txt file. so either it makes this same script for all the urls or it auto leeches urls from a txt file while leeching like when first url is leeched it finds the next url from url txt file and auto inserts into this script so it can run all my urls and at the end i have results of all my urls
5- the final result i get is
http_google.co m,Google
how can i change is "," after URL to a tab or a double space so my results look something like this
http_google.co m Google
kindly reply to all my queries and if possible redo my script so i would know where to put which code
P.S sorry if my post wasnt understandable enuf because i wasnt allowed to post links so i have to delete and redo alot of text
i have also posted my post here for better visual
dpaste.co m/3XG9N9T.txt (remove the space)
i know its nothing but im willing to give a VPN acc of good duration to the helper who can fix my problems
thanks!
Last edited:
