Recent content by Iamhere123

Oh I plan on scraping lots of pages, but this is just me getting used to Selenium Webdriver apache actions :). I'll have to modify the above so I can get the first free row or a unknown range I guess.

Something I'll consider when getting elements. Atm I'm trying to get the data into an excel spreadsheet. -- //www dot dropbox.com/home?preview=the+Writing+to+excel+range.txt It only gets the first lines tho :S. Looking up how to extract for an unknown range. I'm sure there will be answers...

Thanks for the tip. So mysql databases has a big advantage over using vba + excel + Ftp ? Is it simply an online database where you can manipulate excels? I'm going to investigate mysql after I fix excel :D

Sounds interesting :). So the delimiter allows you to use the text file and keep the data separate in the text file. Any good examples on this? II'll see if stack overflow has some examples and try it out.

So getting extracted data and putting it straight into excel is slow where there is a a large quantity of data?

Turns out I was missing a few apache files so it wasn't working properly. Now I'm going to have to dig through some stackoverflow q's and see if I can't write to excel with the extracted data :D.

Hahaha yeah probably a bit overkill huh? I can scrape the data well enough but any excel actions don't seem to work. I have installed apache a few times :S. I wonder if there's a way to verifiy the install through windows :S. I'll be looking at lots of stackoverflow q's to see if I can't...

Scrapy is good but it can't replace an actual browser. Selenium gets the job done where you want to emulate a browser and have no fingerprinting. I thing apache is not working on my pc for some reason . Maybe that's why I keep getting blank excels. Who knows *shrugs*. Time for 5 hours of bug...

Yeah haha except when I do it it just gives me a blank spreadsheet xD. Do you have an example script that works? I'd kill for that..... lmao.

Linux is the best way to bot period. So much more functionality then windows. And yeap, firefox + chrome headless sounds amazing. Can't wait to start using them. If only I could work out how to scrape pages with Selenium *shrugs*. Oh well I suppose I'll look at 500+ pages on stackoverflow...

Your only option is to scrape with Selenium as you can choose your browser or get Exbrowser plugin. Ubot browser is too easily detectable. Though Selenium is quite easy to learn. I am still learning it and can't yet scrape pages but can do a lot of other stuff I don't need

Speaking of helping a brother out, anyone know how to scrape into an excel sheet. I've learnt a lot about selenium except for the only thing I wanted which was how to scrape into excel lmao xD

Hi :). I am trying to build a simple web scraper that extracts data and then puts it into excel. Can anyone help me create this? My link is below at what I've got so far. I simply want it to go here https:at//en.wikipedia.org/wiki/Trinity_Seven#Anime and gets the ep number and title of...