Web scraper

Bigcookies · Jun 3, 2022

How would I scrape truepeoplesearch results? I need to search about 4000 addresses and need a tool that can take the names and addresses and give me a list of phone numbers I tried using scrapebox but they said they can't because the site uses javascript is there a tool that could get this job done I also saw a few things on GitHub but I'm not sure how to use them there's only code and no instructions anyone familiar with coding knows what I should do with the code?

Maxius · Jun 3, 2022

You can do this with goutte and laravel, but you have to know programming with php. If you not familiar you should hire someone who can do that.

Smackhead · Jun 3, 2022

If you want to pm me some more details I put something together to start you off using selenium or puppeteer.

Algo · Jun 3, 2022

RTILA is available on appsumo, take a look at it maybe you can do it with this software.

ManchesterCity · Jun 3, 2022

Easy to do bro, the website use javascript but still render html,
truepeoplesearch /
details?
name= any
&
rid=0x1 ( this is in hex ) = 1

When the page is loaded scrap your data and go to number 0x2

Bigcookies · Jun 3, 2022

ManchesterCity said:
Easy to do bro, the website use javascript but still render html,
truepeoplesearch /
details?
name= any
&
rid=0x1 ( this is in hex ) = 1

When the page is loaded scrap your data and go to number 0x2

so you're saying do it one page at a time? wouldn't that be the same as loading each page 1 by 1? ngl until now I only used scrapebox for email scraping I have no idea what it can really do

MaxiJazz · Jun 3, 2022

ManchesterCity said:
Easy to do bro, the website use javascript but still render html,
truepeoplesearch /
details?
name= any
&
rid=0x1 ( this is in hex ) = 1

When the page is loaded scrap your data and go to number 0x2

Not a JS site, for sure. Easy to scrape

ManchesterCity · Jun 3, 2022

I checked the source and get your point,

ga('send', 'pageview');

the software you are using doesn't render the html.
Coz the page doesn't render it self, it cannot read any data.
to be able to get some data you need to render the html first, get the source from chromium or webkit or whatever, and you will get what you want.

I will code a little bot for you for the sake of bhw community, if you give me a hour or two.

Bigcookies · Jun 3, 2022

ManchesterCity said:
I checked the source and get your point,

ga('send', 'pageview');

the software you are using doesn't render the html.
Coz the page doesn't render it self, it cannot read any data.
to be able to get some data you need to render the html first, get the source from chromium or webkit or whatever, and you will get what you want.

I will code a little bot for you for the sake of bhw community, if you give me a hour or two.

oh mygosh thank you so much

ManchesterCity · Jun 3, 2022

@MaxiJazz don't panic it's just javascript not hard-coded shit like movies
JUST KIDDING

ManchesterCity · Jun 4, 2022

What data you want to scrap ?

Bigcookies · Jun 4, 2022

ManchesterCity said:
What data you want to scrap ?

names and phone numbers

ManchesterCity · Jun 4, 2022

The results will be in json format , everything is done correctly .
I need to add the auto increments ++ and the bot will be ready .

Ps: my vpn ip got limited after 100 try or less
After refreshing the ip it works great so for 1 proxy I think you can do 80 or 100 request.

This IP has been rate limited, sorry for the inconvenience. If you are using a VPN please turn it off when using this service.

Bigcookies · Jun 4, 2022

ManchesterCity said:
The results will be in json format , everything is done correctly .
I need to add the auto increments ++ and the bot will be ready .

Ps: my vpn ip got limited after 100 try or less
After refreshing the ip it works great so for 1 proxy I think you can do 80 or 100 request.

okay thank you so much! you have no idea how much you just helped me

ManchesterCity · Jun 4, 2022

Check this , didn't want to make it 100% automated coz the tps website is completely weird , they use captcha + cloudflare + ...

it works great, you need android device to run it.
Native iimplementation quick and smooth, the bot save every profile to blackhatworld.txt in Documents.

I didn't handle all the exceptions, neither crash log.

If it exactly what you expected let me know to release the apk for you.

Help Desk · Jun 17, 2022

I want to access truepeoplesearch in India but not able to do it with RDP, residential proxy, VPN or VPS can anyone help me. I want to scrape some data from there.

marketer1216 · Jun 21, 2022

ManchesterCity said:
Check this , didn't want to make it 100% automated coz the tps website is completely weird , they use captcha + cloudflare + ...

it works great, you need android device to run it.
Native iimplementation quick and smooth, the bot save every profile to blackhatworld.txt in Documents.
I didn't handle all the exceptions, neither crash log.

If it exactly what you expected let me know to release the apk for you.

I'd be interested in paying you to do setup a system similar to this on a larger scale using truepeople search
please pm me

Endonici · Jun 22, 2022

Bigcookies said:
I tried using scrapebox but they said they can't because the site uses javascript is there a tool that could get this job done I also saw a few things on GitHub

Try Phantombuster

Bigcookies · Jun 23, 2022

Endonici said:
Try Phantombuster

that is probably the coolest software ive ever been recommeneded I love the concept I hate the fact that It doesnt offer an unlimited plan

ProxyFactory · Jun 24, 2022

Reach me if you need help about proxies mate.

Web scraper

Regular Member

Regular Member

Regular Member

Elite Member

Registered Member

Regular Member

Junior Member

Registered Member

Regular Member

Registered Member

Registered Member

Regular Member

Registered Member

Attachments

Regular Member

Registered Member

Regular Member

Newbie

Junior Member

Regular Member

Regular Member

Main Menu

Marketplace

Making Money

BlackHat World