Twitter scraping

H

helpmescrap

Newbie
Joined
Dec 7, 2023
Messages
2
Reaction score
0
hello i am a newbie webscraper i want to scrape twitter is there any advice on what to use and how to do it (preferably without authentication for the tweets section) thanks in advance any advice would be helpfuI
 
Advertise on BHW
They're making it harder and harder to scrape anything meaningful from Xitter because they want you to pay for API access. For starters you can take a look through the Nitter repo on GitHub, and take a look at how their code is handling things: https://github.com/zedeus/nitter
 
if you don't need like tens of thousands scrap you can try manually with "copy all urls", "link grabber" you can do it pretty quickly anf if you can work with text formats you will filter it quick too
 
mafi0za302 said:
if you don't need like tens of thousands scrap you can try manually with "copy all urls", "link grabber" you can do it pretty quickly anf if you can work with text formats you will filter it quick too
Click to expand...
I need thousands of scraps i am trying to build a scraper for it and i need some kind of guideline or roadmap to scraping twitter effectively thanks for your reply
 
We're talking about big X account management software, right?
In our country there are several such software, managing thousands of X accounts with private proxies. Minsoftwave, Genlogin...
 
No, what we're looking is to scrap the content data out of the website as well with posts/media/users and to be readable
S400 Accounts Agent said:
We're talking about big X account management software, right?
In our country there are several such software, managing thousands of X accounts with private proxies. Minsoftwave, Genlogin...
Click to expand...
 
You should be able to scrape with or without accounts with a big residential proxy pool
 
Twitter scraping has changed some over the last few years. Might be best to check updated code on open source websites or have one custom made over on the Hire a Freelance section. As long as what you want to scrape is publicly visible, it should be fine.
 
helpmescrap said:
hello i am a newbie webscraper i want to scrape twitter is there any advice on what to use and how to do it (preferably without authentication for the tweets section) thanks in advance any advice would be helpfuI
Click to expand...
have you tried scrapebox ?
 
helpmescrap said:
hello i am a newbie webscraper i want to scrape twitter is there any advice on what to use and how to do it (preferably without authentication for the tweets section) thanks in advance any advice would be helpfuI
Click to expand...

You can search Twitter's advanced options (https://twitter.com/search-advanced?) to grab public tweets by hashtag or keyword. It won't get you everything, but it's a good way to test the waters. If you're looking to dive deeper, there are tools like Twint (https://github.com/twintproject/twint) that can scrape more, but they might require some coding knowledge.
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top