Permanently Closed Marketplace Sales Thread

Status
Not open for further replies.
Here is mine note after study Add/Train New PlatForms.
1. Fieldname match logic in [step] section:


(search/match) fieldname=variable/value
reg_username={Jack000|%user-name%}


Example:


<form
...
<input...name="reg_username"
...
<input...name="reg_password"
...
<input...name="reg_password2"
...


First will search/check if there are exact/phrase matches. (eg. without*); and is unaffected
by the from up to down order of exact searching fieldnames in a step section.
If matches one, the matched fieldnames in a form will not be searched by the rest search conditions any more.


Second is searching with *.
The process is:
Take the first one with * in a [step], search a fieldname with it in a form from it's top to bottom. It can match more than one fieldnames.
Then the 2nd condition, but the previous matched which had been found with a *, will not affacted by the current/and later searches now.
Then the rest.

The effect is: those without *, their orders in a submission [step] don't affact the final result.
But the order of those with * can influence filling a form. So in theory, related strings with *,
put the long string close to the beginning of step, will increase accuracy. And if there are many .ini file, collect all the fieldname key=value part, if their value part is same, for example, (same) password value, then the numbers of search keys for password field can be reduced, even only left one, by using *.

2. FormMustContain & FormMustNotContain
Login often mixed with Register, so
FormMustNotContain=login*login*login sometimes it's a little dangerous.
Code:
[step]
FormMustContain=register.php"*method=|action=*signup*signup*method=|="joinForm"*method=|register"*method="|creaccount*method=|action=*signup*signup*method=|Confirm password|value="Create account"|type="image"


Formmustnotcontain=action="/search|search*method=|search"*action=|value="search|value="Sign In"|value="Log in"|login.php?*method=|"processlogin"|name="persistent"
 
Last edited:
The Poster searches FormMustContain line from left to right on a page from the top to bottom, if a form is found, and not excluded by FormMustNotContain,
submission begins. Image below illustrates if a very generic string is placed very left, the first matched is a search form, because it's above the rest form on a
page. So idea way is: arrange the very unique strings close to the left, not so sure ones to the right. For example:
FormMustContain=username*email_confirm*new_password|value="Sign up"|recaptcha
And try to weaken Expressing in FormMustNotContain line.
RXU5Jyb
 
Hello!
Purchased the scrapebox today, seems like a very powerful piece of software.

The only question is: how do I extract emails and websites off the every particular page of yellowpages.com using the YP plugin? It seems like the plugin grabs website and email infromation only from the contact listing pages which very rarely have websites and emails displayed. Thats why I'm getting so few of what I'm looking for. I've scraped like 100k companies, got phone numbers for each of em, and for only 200 of them I've got website links and like a couple of email addresses. Which isn't a good result considering almost every company has a website link and most of em display their email on the company page at yellowpages.com. Would be nice to have a way to scrape these company pages at YP. Or at least get all the links to these company pages so I could harvest them using the scrapebox itself.
 
Hello!
Purchased the scrapebox today, seems like a very powerful piece of software.

The only question is: how do I extract emails and websites off the every particular page of yellowpages.com using the YP plugin? It seems like the plugin grabs website and email infromation only from the contact listing pages which very rarely have websites and emails displayed. Thats why I'm getting so few of what I'm looking for. I've scraped like 100k companies, got phone numbers for each of em, and for only 200 of them I've got website links and like a couple of email addresses. Which isn't a good result considering almost every company has a website link and most of em display their email on the company page at yellowpages.com. Would be nice to have a way to scrape these company pages at YP. Or at least get all the links to these company pages so I could harvest them using the scrapebox itself.

You probably should mail in some specific keywords and examples to support, as thats really beyond the scope of what anyone could help you with here. The YPscraper isn't customizeable in the list of pages it scrapes so they would need to modify it, assuming its not just something that isn't ideally configured on your end.

scrapeboxhelp (at] gmail [dot) com
 
Add New Platforms:
9NkCRFY


Platform file footprint need write something there.
HT9HuVn


The Poster determine a platform according to the file name order:
8ravWd1


If rename New.ini to 0New.ini:
oXgrVO4


Because PageMustContain=< in New.ini, it's very common.
Now tumblr is not tumblr because New.ini is "below" other three but above tumblr.ini.
Af6Vj2U


Change New.ini--zNew.ini:
Qdma2tx
 
MustContain/MustNotContain:
Code:
FormMustContain=type="text*type="text*type="text|register.php"*method=|action=*signup*signup*method=|="joinForm"*method=|register"*method="|creaccount*method=|action=*signup*signup*method=|Confirm password|confirm_password|password_confirm|value="Create account"|>Create Account<|signUpForm|pass*type="text*type="text|type="image|type="file|>Albania</option|class="g-recaptcha"|recaptcha|accept-charset="utf-8"|CSRF_TOKEN|size="*size="*size="*size="|enctype="multipart/form-data"|authenticity_token|> *<|AGREEMENT

Formmustnotcontain=action="/login/"|action="/search|search*method=|search"*action=|value="search|search-box|search-btn|value="Sign In"|value="Log in"|login.php?*method=|"processlogin"|name="persistent"|subscribe-form|newsletter-form|newsletterPopup|/subscribe.php"*method="|type="submit"*name="Subscribe"
 
Just thought I would post up. Scrapebox released .59 today and when you update to it the addons and plugins throw an error saying they are not digitally signed. So just go to help >> restore previous version. Then wait for the next update. Same thing happens to me and I talked with some other folks and they said the same for them.

Anyway, support knows about it and they are working on it, but I think its the middle of the night where Sweetfunny lives. Anyway Im sure they will fix it up as soon as is feasible and .58 still works just fine.

(sorry for the ugly green, but I know 3000 people are about to flood this thread with the same message so thought I would be in your face about it, lol)
 
Or move/backup to a path:
You can create a folder: scrapebox\Configuration\Platforms\Folder and move some platform files into it (temporarily). Without closing the Poster window, move a/some files from the folder back to Configuration\Platforms and move current working .ini to Platforms\Folder.
 
j53UYL4


Then make a copy of A.ini
luKNK68


Move A.ini to Backup folder if you like.
hK2kJUk


Or directly build one/mor than one .ini file.
TCB5wou

Don't need restart ScrapeBox/close-open Poster window.
 
In a/one section of .ini file,(Microsoft .ini format), from left to right condition (each LoadUrl setting line)(case sensitive), if one of the condition is matched......
LoadUrl=
LoadUrlFromAnchor=
Case Insensitive now.
 
Don't need restart ScrapeBox/close-open Poster window.....
So that I have some files, and copy/paste|drag them under ..\Configuration\Platforms and these files will working?
 
For instance I can copy one and rename filename and also change it's FriendName. [step] has about
100 lines in it, click - will fold it so can edit [step1] quickly. Rename step1 to Qstep1 or something else so that this step will not be excuted; The [Must....] is not a valid command, will not be excuted either.
Code:
LoadurlFromAnchor=Join|Sign Up|SIGN UP!|Register|Register FREE|Join now|Get Started
Loadurl=/account/signup|action=register|register.php|register.htm|Join.aspx?|loginregistration|/registration/new|/join-now|/signup|sign_up|sign-up|join-us|/joinus|/Join-|account/register|registration.htm|new_user|-registration/|-Registration|/register/|/join|/account.htm?|/my-account/|Account.aspx|/account.php|account.html|/accounts|/MyAccount.aspx|wp-login.php

FormMustContain=type="text"*type="text"*type="text"|>Privacy Policy<|type="text*type="password*type="email"|type="text"*type="text"*type="email"*type="password" |register.php"*method=|action=*signup*signup*method=|="joinForm"*method=|register"*method="|creaccount*method=|action=*signup*signup*method=|Confirm password|confirm_password|password_confirm|value="Create account"|>Create Account<|signUpForm|agreed"|type="file|>China</option|class="g-recaptcha"|recaptcha|accept-charset="utf-8"|CSRF_TOKEN|size="*size="*size="*size="|enctype="multipart/form-data"|authenticity_token|> *<|AGREEMENT|type="image|action="/join?|type="submit"*>Continue<|register.php

Formmustnotcontain=login.php?*method="|subscribe.php"*method=|search*method=|search*action=|action="/search|action="/login/"|value="search|"login-form"|value="Sign In"|value="Log in"|"processlogin"|name="persistent"
;login"*action="|login"*method="
 
Any update on the expired web 2.0 scraping addon?

I can't say anything specific because I know nothing specific. What I do know is that they removed it from the plugins list and they are working to rebuild it. Sweetfunny said it was a top priority, but they were having to rebuild it from scratch and said it make take some builds to sort out some issues.

It was crashing in certain cases or hanging and causing data loss. They wanted it to work properly of course so they were redoing it. ITs a bit of a complex piece, or at least it seems that way to me based on incorporating many components of different addons.

I know they haven't given me an update beta to try so I can only imagine they are still feverishly working on it.
 
Is there anyway to hide Scrapebox in the background while running the automater?
 
Wanted to know if those plugins are included in this BHW scrapebox package?

And are those plugins useful?
 
Status
Not open for further replies.
Back
Top