Looking for C# Developer (Web Scraping)

Hello,

we are looking for a C# Developer who can help us with a webscraping project. The goal is to scrape product and category data from 4 online Shops. We need the following information from each of the shops:

Category Tree:

• Name of each category
• URL of each category
• Hierarchy information

Category:

• All product URLs of a given category, prefiltered for a price Range and the number of reviews (if available)

Product:

• Name
• Brand
• GTIN13 / EAN
• MPN
• Description (as HTML)
• Bulletpoints (not available at all shops)
• Price
• URLs of the Images
• Properties

IMPORTANT: You will only have to extend our abstract classes, meaning you only have to write the Code that takes the URL of the product / category and return a C# object. You do not have to do any processing or exporting of the data. This means you also dont have to deal with any proxy rotation, HTTP retry logic or scraping protection. Make it work for a single URL, we will take care of the rest. We do not want to use any sort of JavaScript rendering. No Chromedriver or other bloat, its not necessary and only brings instability, worse performance and problems for DevOps.

To make it clear what is expected, a public Github Repository was setup: https://github.com/rebound-team/rebound-outsource
You would have to extend the https://github.com/rebound-team/rebound-outsource/blob/master/ReboundOutsource/Scraper/Base/ProductScraper.csand https://github.com/rebound-team/rebound-outsource/blob/master/ReboundOutsource/Scraper/Base/CategoryScraper.cs classes for each of the shops. Nothing more, nothing less. I have already done this for other shops myself and can guide you through the process in case any questions arise. We also added a few helper functions that have proven useful in the past, however its up to you if you want to use them. I created two barebone classes for the first shop, please contact us privatly if you want the full list of shops.

Since everyone in our team also has a technical background we know how annoying it can be to deal with clients. We will not be asking you to "just implement this little feature, because its just like 5 minutes of work" or any other bullshit. You implement those classes, you get that money. We also took a look at the shops we need beforehand and have excluded some properties at specific shops because they were deemed out of scope (for example if a property is only available in a PDF).

You will push your work into another GitHub repository that we will give you access to, do not create a pull request for the public repository, this is not a open source project.

Payment: We are paying 350$ total for all 4 shops in BTC / USDT. Payment after each shop is possible.

Please contact use before you start to work if interested, we would prefer if a single person can do all 4 shops. Delivery should be completed in the next 2 weeks and we are only really interested if you can get started right away.

Contact:
Telegram: @rebound_admin (https://t.me/rebound_admin)
Jabber / XMPP: [email protected] (Gajim / OMEMO encryption only, OTR Requests will be rejected)

If you are a scammer, please refrain from contacting me. The position is still open, please be ready to verify your BHW account.

To clarify: I will not provide any sort of pre payment. I am ready to proof both my financial capability to pay for the service and can deposit the money in an escrow if needed.

Sadly i cant edit the original post anymore but if you are new to webscraping or inexperienced at working with C# (for example if you come froma web dev context) please still dont hesitate to contact me. I am ready to guide you through the process of creating your first scrapers and help you if needed, I am seeing this as a long term partnership and have some other ideas of what you could help develop. However, i expect at least good programming skills in some other language / framework. I will not teach you how to program.