1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Looking for a URLs filtering software.

Discussion in 'Black Hat SEO Tools' started by RiTu, Jun 17, 2010.

  1. RiTu

    RiTu Regular Member

    Joined:
    Oct 28, 2007
    Messages:
    403
    Likes Received:
    158
    Location:
    shiver down your spine
    I need an application(s) to:

    -trim ULRs to root (http://google.com/lolcats to http://google.com)
    -delete duplicates
    -convert emails to domains (lolcat@google.com to google.com)

    and other stuff like that.

    I know that I can use Excel, Xrumer or Scrapebox to do some of them but come on...halp me.
     
  2. Dzixond

    Dzixond Newbie

    Joined:
    Dec 4, 2008
    Messages:
    18
    Likes Received:
    8
    you can use Textpad, record simple macro and loop playing it until end of file.
     
  3. peterlolz

    peterlolz Junior Member

    Joined:
    Jan 27, 2009
    Messages:
    135
    Likes Received:
    479
    this c#.net code does it for you :) (3min coding ;P), you just have to put your urls/emails into the arrays and export the lists.

    Code:
    using System;
    using System.Collections.Generic;
    using System.Linq;
    using System.Text;
    using System.Text.RegularExpressions;
    
    namespace ConsoleApplication1
    {
        class Program
        {
            static void Main(string[] args)
            {
                string thisurltrimmed;
                string[] urlarray = { "http://www.google.de/lol", "http://www.yahoo.de/cat" };
                List<string> urlstrimmedarray = new List<string>();
    
                string thisemailtrimmed;
                string[] emailarray = { "quak@google.de", "quak@yahoo.de" };
                List<string> emailstrimmedarray = new List<string>();
    
                Console.WriteLine("URLs trimmed:");
                foreach (string thisurl in urlarray)
                {
                    thisurltrimmed = Regex.Match(thisurl, "(http://)?([^/]*)").ToString();
                    if (!(urlstrimmedarray.Contains(thisurltrimmed)))
                    {
                        Console.WriteLine(thisurltrimmed);
                        urlstrimmedarray.Add(thisurltrimmed);
                    }
                }
    
    
                Console.WriteLine("emails trimmed:");
                foreach (string thisemail in emailarray)
                {
                    thisemailtrimmed = Regex.Match(thisemail, "@(.*)").Groups[1].ToString();
                    if (!(emailstrimmedarray.Contains(thisemailtrimmed)))
                    {
                        Console.WriteLine(thisemailtrimmed);
                        emailstrimmedarray.Add(thisemailtrimmed);
                    }
                }
    
    
                Console.ReadLine();
            }
        }
    }
    
     
    • Thanks Thanks x 1
  4. RiTu

    RiTu Regular Member

    Joined:
    Oct 28, 2007
    Messages:
    403
    Likes Received:
    158
    Location:
    shiver down your spine
    thanks. any other?
     
  5. peterlolz

    peterlolz Junior Member

    Joined:
    Jan 27, 2009
    Messages:
    135
    Likes Received:
    479
    5$ and I will send you the tool. It will be possible to set an input file and an output file or an input and output textbox for the emails/domains and it will be really fast.
    just pm me
    peterlolz