1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Scrape twitters timeline shortlinks

Discussion in 'Black Hat SEO Tools' started by manpreet, Dec 29, 2016.

  1. manpreet

    manpreet Regular Member

    Joined:
    Nov 3, 2011
    Messages:
    330
    Likes Received:
    31
    is there a quick way to get all my timelines t.co links from my timeline, i have 1000s so manually it will take ages. i tried getting the archive file from twitter but it only gives me the expanded urls, also tried some only sites but again only gives me approx x20 urls (maybe due to 'show more')
     
  2. picapiedra18

    picapiedra18 Regular Member

    Joined:
    Jan 30, 2009
    Messages:
    399
    Likes Received:
    242
    Gender:
    Male
    Location:
    La Perla del Pacifico
    Home Page:
    No help here, but interested to know this too
     
  3. manpreet

    manpreet Regular Member

    Joined:
    Nov 3, 2011
    Messages:
    330
    Likes Received:
    31
    any scraper available for t.co links all scrapers free are for followers or tweet contents
     
  4. HoNeYBiRD

    HoNeYBiRD Jr. VIP Jr. VIP

    Joined:
    May 1, 2009
    Messages:
    7,507
    Likes Received:
    8,436
    Gender:
    Male
    Occupation:
    Geographer, Tourism Manager
    Location:
    Ghosted
    Grab your favorite browser. Head over to the Twitter account in question. Scroll down to the end of the timeline (hold down the space button or maybe you can use a jQuery too). Open page source. Copy content. Paste it into an empty file in Notepad++, use the Search/Mark function to mark lines with the "t.co/" pattern in them, remove the unmarked lines (Search/Bookmark/Remove unmarked lines). See if the result needs further cleaning or no. If yes, remove any redundant data with the Search/Replace function or you can use Excel as well for this purpose.

    It's one way to do it for free and fairly quick, there might be more elegant solutions out there. :)
     
    • Thanks Thanks x 1
  5. maxy007

    maxy007 Registered Member

    Joined:
    Jun 16, 2015
    Messages:
    83
    Likes Received:
    10
    do what HoNeYBiRD said , and pm me with the page source
     
    • Thanks Thanks x 1
  6. manpreet

    manpreet Regular Member

    Joined:
    Nov 3, 2011
    Messages:
    330
    Likes Received:
    31
    Thanks guys. Had been looking for this, im pretty good with excel so can clean with ease