How do I scrape Tweets with scrapebox?

D

Dilettante

Power Member
Joined
Jan 9, 2014
Messages
777
Reaction score
308
Hello,

I would like to try to scrape tweets with scrapebox with the custom data grabber.

It's really new for me, and I asked to the support which told me to take a look to this video:
HTML: 
https://www.youtube.com/watch?v=X3Ep-NXg4kY

I understand some things, but I can't find a regular expression for tweet content. I can find them to scrape usernames, but not for tweet.

Do you know what i should do? Or where I could find this regular expression?

Thanks.
 
Advertise on BHW
I think I replied you on anther forum, but Ill code it for you for free, but don't over think it. I had a look at twitter with javascript turned off and something to the tune of


before_after=tweet-text tweet-text" lang="en" data-aria-label-part="0">|</p>

etc.. would work, probably. I mean you could mess with it, I didn't test it to see if it would return false positives, but the before after marker is pretty handy and makes it quick and simple to get in and test and get what you want in many cases, in fact probably most cases.
 
Devil Rider said:
This link building technique utilises some of the free plugins that you can get from Scrapebox, the main tactic in this technique is to find a compromised or malware infected site and open a dialogue with the site owner in an attempt to receive a link either via a Guest Post or by suggesting the site owner replaces broken links with your own.
Click to expand...
LOL...You ride like Hell!
@OP , why don't you accept loopline's proposal?
 
Last edited:
If you have scrapebox and Loopline provides you with advice, I propose you follow his advice I use scrapebox and mot of the "tricks" I learned was by following Loopline on various forums. My advice is follow his advice.
 
buddy you can follow this site
https://www.youtube.com/watch?v=X3Ep-NXg4kY
 
loopline said:
I think I replied you on anther forum, but Ill code it for you for free, but don't over think it. I had a look at twitter with javascript turned off and something to the tune of


before_after=tweet-text tweet-text" lang="en" data-aria-label-part="0">|</p>

etc.. would work, probably. I mean you could mess with it, I didn't test it to see if it would return false positives, but the before after marker is pretty handy and makes it quick and simple to get in and test and get what you want in many cases, in fact probably most cases.
Click to expand...
@loopline. Can you dm me. I really would like to learn from you. You have inspired me in this world

Brian
 
MassASAP said:
@loopline. Can you dm me. I really would like to learn from you. You have inspired me in this world

Brian
Click to expand...
My 2 cents for Scrapebox mastery is to learn to read the webpage sources.

ie view-source:https://genericwebsite.com

By doing this a lot with different platforms and or themes you can very quickly identify the text you need to use as tokens to scrape data.

The data grabber is one of, if not the best tools in Scrapebox and I think it gets overlooked far too often.
 
bendutchman said:
My 2 cents for Scrapebox mastery is to learn to read the webpage sources.

ie view-source:https://genericwebsite.com

By doing this a lot with different platforms and or themes you can very quickly identify the text you need to use as tokens to scrape data.

The data grabber is one of, if not the best tools in Scrapebox and I think it gets overlooked far too often.
Click to expand...
I appreciate the replay. Can you elaborate webpage sources?
 
MassASAP said:
I appreciate the replay. Can you elaborate webpage sources?
Click to expand...
either hit ctrl u or right-click on the page you want to scrape and you will get the page source.
for example, if you want to grab the title of the website, in most cases the tokens would be <title> </title>
To use this in the customer data grabber you would add the following as a mask: before_after=<title>|</title>
Or you can use regex (?<=<title>)(.*)(?=</title>)

The good thing with the custom data grabber is you can grab as many little snippets of information as you like from each page scraped.
Save them as 1 continuos file, CSV, and as separate files for each page.
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top