1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Can Scrapebox 2.0 get prices from URL lists?

Discussion in 'Black Hat SEO Tools' started by Thu Thao, Jun 4, 2017.

  1. Thu Thao

    Thu Thao Newbie

    Joined:
    Jun 4, 2017
    Messages:
    16
    Likes Received:
    3
    Gender:
    Female
    I just started using Scrapebox for crawling data from website. I want to extract the price from the product URL. Is there a method on Scrapebox that can help me do that? I used Regex to try to implement it but failed. I thank all of your contributions on my problem.
     
  2. SpoonFeeder

    SpoonFeeder Regular Member

    Joined:
    Mar 19, 2017
    Messages:
    399
    Likes Received:
    270
    Gender:
    Male
    Occupation:
    SpoonFeeding & Babysitting the Noobs
  3. TheDevloper

    TheDevloper Newbie

    Joined:
    Jul 31, 2015
    Messages:
    25
    Likes Received:
    3
    Occupation:
    Game Devloper
    Location:
    Tigumi
    Home Page:
    i know images can be scrapped with scrapbox but not prices.
    i wish i could help.
     
    • Thanks Thanks x 1
  4. Thu Thao

    Thu Thao Newbie

    Joined:
    Jun 4, 2017
    Messages:
    16
    Likes Received:
    3
    Gender:
    Female
    An interesting duplication. I'm reading your posts. Stackoverflow has not given me the solution yet
     
  5. W9go

    W9go Jr. VIP Jr. VIP Premium Member

    Joined:
    May 16, 2011
    Messages:
    4,632
    Likes Received:
    932
    Gender:
    Male
    Occupation:
    chasing girls
    Location:
    chasing girls
    what is scrape box 2.0 ?
     
  6. SpoonFeeder

    SpoonFeeder Regular Member

    Joined:
    Mar 19, 2017
    Messages:
    399
    Likes Received:
    270
    Gender:
    Male
    Occupation:
    SpoonFeeding & Babysitting the Noobs
    BHW is the only community where ScrapeBox is discussed a lot.

    Please paste the product URL from where you want to scrape the pricing from and I'll see If I can Spoon Feed you the guide.

    @W9go ScrapeBox 2.0 is completely rebuilt and comes with a lot more features than the first version like Unicode support, 64-bit and built with up to date compiler.


    Code:
    http://www.scrapebox.com/v2-beta
     
  7. SpoonFeeder

    SpoonFeeder Regular Member

    Joined:
    Mar 19, 2017
    Messages:
    399
    Likes Received:
    270
    Gender:
    Male
    Occupation:
    SpoonFeeding & Babysitting the Noobs
    @Rongreu posted the same reply just a few mins ago and deleted it in a minute.

    Why do you have 2 BHW accounts?
     
  8. Thu Thao

    Thu Thao Newbie

    Joined:
    Jun 4, 2017
    Messages:
    16
    Likes Received:
    3
    Gender:
    Female
    Sorry if that annoys you. I have problems with my old gmail and I am canceling it.
     
  9. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,726
    Likes Received:
    1,994
    Gender:
    Male
    Home Page:
    You can use the custom data grabber to get the price. Here is a video

     
    • Thanks Thanks x 3
  10. Thu Thao

    Thu Thao Newbie

    Joined:
    Jun 4, 2017
    Messages:
    16
    Likes Received:
    3
    Gender:
    Female
    Thank you @loopline. A useful video. I will study about it.
     
  11. themrgarycole

    themrgarycole Newbie

    Joined:
    Jun 2, 2017
    Messages:
    7
    Likes Received:
    0
    Gender:
    Male

    Cool! Thanks for sharing this video @loopline. I didn't realize that this can be done (customize). lol
     
  12. Thu Thao

    Thu Thao Newbie

    Joined:
    Jun 4, 2017
    Messages:
    16
    Likes Received:
    3
    Gender:
    Female
    Hello @loopline. Here is my configuration to get the "price" from the URL. I tried some Regex code for eg "6pm.com/p/lucky-brand-april-crossbody-black/product/8798523/color/3?zlfid=192&ref=pd_detail_2_sims_sdp" but it does not work. Hope you can help me one more time.

    [Settings]
    MenuEntry = Grab price from harvested URL list
    Folder = Grabbed Price
    GuiCaption = Grab price check
    ColumnHeader = # Items Found
    TrayBalloon = Done checking URL Price
    Connections = 1
    Timeout = 30
    SaveUrls = 1

    [Definition1]
    Name = Grab price
    Example = 2000
    RegEx = \\ $ \\ d + [.]? \\ d *
    MustContain =
    MustNotContain =
    Enabled = 1
     
  13. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,726
    Likes Received:
    1,994
    Gender:
    Male
    Home Page:
    you welcome. :)

    This is the line with the price

    <div id="price" class="price" itemprop="price">$91.14</div>

    so just do
    before_after=<div id="price" class="price" itemprop="price">|</div>

    meaning just do the before/after in place of the regex

    I just tried that and it worked for me to get the $91.14
     
    • Thanks Thanks x 2
  14. Thu Thao

    Thu Thao Newbie

    Joined:
    Jun 4, 2017
    Messages:
    16
    Likes Received:
    3
    Gender:
    Female
    Hello @loopline. I watched your "Scrapebox Phone Number Scraper" video and made a Regex for the price. My Regex: (\ $ \ s? [0-9,] + (\. [0-9] {2})?). Actually it worked. However, the result is all the price on the Product URL, which is not good and makes it difficult to remove unnecessary prices. I will try your method to find better results. Will your method run automatically with a URL list? Thanks @loopline so much
     
  15. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,726
    Likes Received:
    1,994
    Gender:
    Male
    Home Page:
    My method gave me back only the 1 price of the product, because its a match on the exact html, not a regex to match prices.
     
    • Thanks Thanks x 1
  16. Thu Thao

    Thu Thao Newbie

    Joined:
    Jun 4, 2017
    Messages:
    16
    Likes Received:
    3
    Gender:
    Female
    Thank you @loopline . Have a nice work day
     
  17. Thu Thao

    Thu Thao Newbie

    Joined:
    Jun 4, 2017
    Messages:
    16
    Likes Received:
    3
    Gender:
    Female
    Hello @loopline. Can I use it to get the "Description" of the product? Please help me again. Thanks @loopline very much
     
  18. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,726
    Likes Received:
    1,994
    Gender:
    Male
    Home Page:
    it will be a mess, but sure.

    The before is
    <div class="description" itemprop="description">

    and the after is
    </div>

    You can look at the html and see where I got those and go from there. IT will be the entire description all on 1 line.
     
    • Thanks Thanks x 2
  19. Thu Thao

    Thu Thao Newbie

    Joined:
    Jun 4, 2017
    Messages:
    16
    Likes Received:
    3
    Gender:
    Female
    Thank you @loopline
     
  20. Zwielicht

    Zwielicht Moderator Staff Member Moderator Jr. VIP

    Joined:
    Aug 31, 2013
    Messages:
    6,612
    Likes Received:
    11,754
    Gender:
    Male
    Occupation:
    Private Investigator
    Location:
    Riverside, California
    Home Page:
    You can only have one account here.

    Pick the one you want to keep so I can ban the other.

    If you fail to respond, I'll pick one myself...