1. This website uses cookies to improve service and provide a tailored user experience. By using this site, you agree to this use. See our Cookie Policy.
    Dismiss Notice

scraping data for a directory

Discussion in 'Scripting' started by therealrio, Sep 4, 2019.

  1. therealrio

    therealrio Junior Member

    Joined:
    Apr 24, 2015
    Messages:
    145
    Likes Received:
    15
    Home Page:
    I need to put together a business directory on a town per town basis, as in one town at a time, using about 10 different categories.

    I can hire someone to manually scrape data from say yellow pages or super pages existing directories and make a spreadsheet. But this could be costly.

    What other options do i have?

    Someone could write a software that scrapes data and i just enter the town/city and keywords and it extracts info i need into a csv file. But with this method im sure you would get negative data, in that its not appropriate, so someone would have to manually check the scraped data atleast once.

    Any advice or offers welcome
     
  2. Iwillsolo

    Iwillsolo Newbie

    Joined:
    Jun 3, 2018
    Messages:
    2
    Likes Received:
    1
    Gender:
    Male
    I can write a script that will extract/scrap the specific data you want and save into a csv

    The data will be accurate and it will scrap specifically what you want to scrap only
     
    • Thanks Thanks x 1
  3. yourdady

    yourdady Jr. VIP Jr. VIP

    Joined:
    Apr 4, 2014
    Messages:
    581
    Likes Received:
    110
    Gender:
    Male
    Occupation:
    Freelancer
    Location:
    London
    Botsol software is what you need..!
     
  4. Purush

    Purush Jr. VIP Jr. VIP

    Joined:
    Jul 12, 2016
    Messages:
    5,095
    Likes Received:
    1,477
    Gender:
    Male
    Home Page:
    First pull the data by auto method then check it manually
     
  5. therealrio

    therealrio Junior Member

    Joined:
    Apr 24, 2015
    Messages:
    145
    Likes Received:
    15
    Home Page:
    pm me detials
     
  6. Iwillsolo

    Iwillsolo Newbie

    Joined:
    Jun 3, 2018
    Messages:
    2
    Likes Received:
    1
    Gender:
    Male
    for some reason i can't pm if u can start a conv, so we can talk or provide any other contact details
     
  7. kaiba910

    kaiba910 Registered Member

    Joined:
    Mar 12, 2008
    Messages:
    61
    Likes Received:
    1
    Kindly pm me the details of the directory and I'll try to scrape it using Python. I am currently learning Python and looking to apply my knowledge in different challenges.

    If I manage to scrape it, I'll let you know and it'll be at an affordable price.
     
  8. jl125

    jl125 Newbie

    Joined:
    Oct 10, 2019
    Messages:
    22
    Likes Received:
    3
    Gender:
    Male
    Pretty simple scraping bot honestly.
     
  9. xposetechy

    xposetechy Newbie

    Joined:
    Nov 10, 2019
    Messages:
    4
    Likes Received:
    0
    Gender:
    Male
    some extractors are there...
     
  10. EncodeKing

    EncodeKing Regular Member

    Joined:
    Jan 17, 2014
    Messages:
    468
    Likes Received:
    133
    Gender:
    Male
    Location:
    Himalayas
    Try webharvy. I think it's what you're looking for