Creating a selenium Webscraper (Help)

Hi . I am trying to build a simple web scraper that extracts data and then puts it into excel. Can anyone help me create this? My link is below at what I've got so far.

I simply want it to go here https:at//en.wikipedia.org/wiki/Trinity_Seven#Anime and gets the ep number and title of anime and write that to excel col 1 and 2.

Thanks


--www dot dropbox.com/s/dmyym3swhapuno7/Selenium%20Scraper.txt?dl=0--

Iamhere123 said:

Hi . I am trying to build a simple web scraper that extracts data and then puts it into excel. Can anyone help me create this? My link is below at what I've got so far.

I simply want it to go here https:at//en.wikipedia.org/wiki/Trinity_Seven#Anime and gets the ep number and title of anime and write that to excel col 1 and 2.

Thanks


--www dot dropbox.com/s/dmyym3swhapuno7/Selenium%20Scraper.txt?dl=0--

Click to expand...

Try to find the title by class name instead of xpath(code may be a little different in java, the c# version is this):
Instead of:

Also, you don't have to scrape the ep number, because the titles are in order.

Something I'll consider when getting elements. Atm I'm trying to get the data into an excel spreadsheet.
-- //www dot dropbox.com/home?preview=the+Writing+to+excel+range.txt

It only gets the first lines tho :S. Looking up how to extract for an unknown range. I'm sure there will be answers hidden on stackoverflow or some website somewhere. Undoubtedly a simple fix which I am over complicating

I'm trying to find atm firstfreerow to see if it can't extract to that..

public static boolean isRowEmpty(Row row) {
for (int c = row.getFirstCellNum(); c < row.getLastCellNum(); c++) {
Cell cell = row.getCell(c);
if (cell != null && cell.getCellType() != Cell.CELL_TYPE_BLANK)
return false;
}
return true;

Use a tool like this : http://www.convertcsv.com/html-table-to-csv.htm to transform the table into a CSV you can import into excel.

If you only wanna do one URL, writing a bot is a waste of time.

Oh I plan on scraping lots of pages, but this is just me getting used to Selenium Webdriver apache actions . I'll have to modify the above so I can get the first free row or a unknown range I guess.