Scrapebox - new update problems

lazlopanaflex · Oct 15, 2020

Scrapebox was working great but now I am having problems with new updates.

1. The default inbuilt browser was removed, it was a great tool!

2. it is not crawling all emails even when listed on the webpage. for example
https://www.instagram.com/jaazakokko/

These things worked perfectly before!

Therankingrush · Oct 16, 2020

2. Problem is from beginning. And it's take so much time to scrape emails or any data.

loopline · Oct 16, 2020

lazlopanaflex said:
Scrapebox was working great but now I am having problems with new updates.

1. The default inbuilt browser was removed, it was a great tool!

2. it is not crawling all emails even when listed on the webpage. for example
https://www.instagram.com/jaazakokko/

These things worked perfectly before!

What is it that you need to do with the inbuilt browser?

#2 It will scrape any emails not produced by javascript. However much of instagram including the infinite scroll is produced with a script. Scrapebox does not render the script, so it can only see what loads on the initial page load.

nirose · Oct 16, 2020

loopline said:
What is it that you need to do with the inbuilt browser?

#2 It will scrape any emails not produced by javascript. However much of instagram including the infinite scroll is produced with a script. Scrapebox does not render the script, so it can only see what loads on the initial page load.

checked the page, it is loaded with javascript, but it is in the initial source code.

cryptexon · Oct 16, 2020

loopline said:
What is it that you need to do with the inbuilt browser?

#2 It will scrape any emails not produced by javascript. However much of instagram including the infinite scroll is produced with a script. Scrapebox does not render the script, so it can only see what loads on the initial page load.

Hey, this is a common scam to get you to an Instagram page using this forum. This is obvious spam ))

lazlopanaflex · Oct 16, 2020

loopline said:
What is it that you need to do with the inbuilt browser?

#2 It will scrape any emails not produced by javascript. However much of instagram including the infinite scroll is produced with a script. Scrapebox does not render the script, so it can only see what loads on the initial page load.

It made it so easy to go through the harvested links by just clicking the arrows (back/forward) to see the quality of collected data. Now I have to open them all at once or one by one in native browser. I thought the internal browser was super slick!

I was able to capture emails from instagram before, never had any issues. But as @nirose pointed It is loaded by javascript and is only the actual web page/source. So it should still work, no?

Btw, I really enjoy your videos! Are you the developer for SB?

loopline · Oct 17, 2020

lazlopanaflex said:
It made it so easy to go through the harvested links by just clicking the arrows (back/forward) to see the quality of collected data. Now I have to open them all at once or one by one in native browser. I thought the internal browser was super slick!

I was able to capture emails from instagram before, never had any issues. But as @nirose pointed It is loaded by javascript and is only the actual web page/source. So it should still work, no?

Btw, I really enjoy your videos! Are you the developer for SB?

No Im not the developer, I don't work for them, I just put out videos and help and such. Glad you found the videos useful and helpful!

The email grabber didn't change so it should still scrape whatever it did before from instagram. That said

Instgram could have changed
Your security software could be blocking it
could be a proxy issue or some other error stopping it
etc...

So what happens, you get errors or it just says completed with no emails or ?

lazlopanaflex · Oct 17, 2020

loopline said:
No Im not the developer, I don't work for them, I just put out videos and help and such. Glad you found the videos useful and helpful!

The email grabber didn't change so it should still scrape whatever it did before from instagram. That said

Instgram could have changed
Your security software could be blocking it
could be a proxy issue or some other error stopping it
etc...

So what happens, you get errors or it just says completed with no emails or ?

No errors nothing, it just shows 0 in the email collected column for all the instagram URLs.
I had double checked all proxies and no new security software installed on the machine.

I have not seen any changes on insta profile page either to show that they changed the way email is listed.

everything was working perfectly until last week

cryptexon · Oct 17, 2020

instagram requires a session to see the content otherwise you will only see the login page. open the page in private mode and ... you will not see anything except the login forms, the parser needs a session for this. but instead, you can use google as an assistant and collect information from it like this -

Code:

site:instagram.com (intext:"@gmail.com" | intext:"@yahoo.com")

and etc

loopline · Oct 17, 2020

lazlopanaflex said:
No errors nothing, it just shows 0 in the email collected column for all the instagram URLs.
I had double checked all proxies and no new security software installed on the machine.

I have not seen any changes on insta profile page either to show that they changed the way email is listed.

everything was working perfectly until last week

Can you give a few sample urls that have emails on them?

lazlopanaflex · Oct 18, 2020

loopline said:
Can you give a few sample urls that have emails on them?

https://www.instagram.com/sustainableci/
https://www.instagram.com/amelianatasha_/
https://www.instagram.com/feeds4speed/

loopline · Oct 20, 2020

lazlopanaflex said:
https://www.instagram.com/sustainableci/
https://www.instagram.com/amelianatasha_/
https://www.instagram.com/feeds4speed/

I took your first url as an example and used just the normal email scraper in the core of scrapebox and ran it and it returned

[email protected]|https://www.instagram.com/sustainableci/
[email protected]|https://www.instagram.com/sustainableci/

You get zero?

Do you have an IP from what geographic location? Its possible Instagram is throwing up splash pages based on your ip geo location. For example some sites throw up a GDPR page for EU based IPs and there is no way to get around it. So you could try like a USA proxy IP as an example and see if it works. It works with my USA IP.

lazlopanaflex · Oct 21, 2020

loopline said:
I took your first url as an example and used just the normal email scraper in the core of scrapebox and ran it and it returned

[email protected]|https://www.instagram.com/sustainableci/
[email protected]|https://www.instagram.com/sustainableci/

You get zero?

Do you have an IP from what geographic location? Its possible Instagram is throwing up splash pages based on your ip geo location. For example some sites throw up a GDPR page for EU based IPs and there is no way to get around it. So you could try like a USA proxy IP as an example and see if it works. It works with my USA IP.

You are absolutely correct! Proxies was the issue

Thank you so much

And I thought I was a fan of you before haha

loopline · Oct 22, 2020

lazlopanaflex said:
You are absolutely correct! Proxies was the issue

Thank you so much
And I thought I was a fan of you before haha

Great glad you got it working.

lazlopanaflex · Nov 2, 2020

Is there a way to limit the number of results by keyword on SB?
For example, if I enter 5 custom keywords and I want each keyword to collect first 500 results, how can I do that?

Right now I enter one value, example 2500 then I have no idea how that number is being used to harvest for each keyword. I'd appreciate if you can offer some feedback on this.

Thank you

loopline said:
Great glad you got it working.

Thank you

loopline · Nov 4, 2020

The results box controls many results are scraped as a maximum, for a given keyword. Its in the lower left hand quadrant of the main scrapebox window on windows - and the upper right hand quadrant on mac.

So if you want 500 results per keyword, just put 500 in that box.

x.software · Apr 10, 2022

Does anyone know a good content parser? Can Scrapebox parse articles?

loopline · Apr 12, 2022

x.software said:
Does anyone know a good content parser? Can Scrapebox parse articles?

Yes there is the article scraper addon and plugin which can both do it.

Or if you want something besides articles and just pieces of info there is the custom data scraper and the robust custom data scraper that is part of the email scraper plugin.

Scrapebox - new update problems

Junior Member

Newbie

Elite Member

Elite Member

Registered Member

Junior Member

Elite Member

Junior Member

Registered Member

Elite Member

Junior Member

Elite Member

Junior Member

Elite Member

Junior Member

Elite Member

Newbie

Elite Member

Main Menu

Marketplace

Making Money

BlackHat World