Anyone good with selenium (python)?

bk071 · Jul 29, 2017

Iamhere123 said:
Sounds interesting . So the delimiter allows you to use the text file and keep the data separate in the text file.

Correct.

Iamhere123 said:
Any good examples on this? II'll see if stack overflow has some examples and try it out.

I don't have any sample code to show you. But it shouldn't be hard. Put a semicolon after every column while writing to file.

On a side note, I always prefer storing the scraped data in a mysql database. Its much easier to query and if you need a csv you can always export it from a mysql admin took like phpmyadmin.

Iamhere123 · Jul 29, 2017

Thanks for the tip. So mysql databases has a big advantage over using vba + excel + Ftp ? Is it simply an online database where you can manipulate excels? I'm going to investigate mysql after I fix excel

bk071 · Jul 29, 2017

Iamhere123 said:
Thanks for the tip. So mysql databases has a big advantage over using vba + excel + Ftp ? Is it simply an online database where you can manipulate excels? I'm going to investigate mysql after I fix excel

It doesn't have to be online. And both excel / MySQL have their own advantages. Depends on the data and what you're doing with it.
Just do some googling and you'll figure out what the best solution is for your specific project.

Al Ali · Jul 29, 2017

Have you got my reply? I don't have Sk1pe.

sirmeep · Jul 29, 2017

bk071 said:
I always prefer storing the scraped data in a mysql database. Its much easier to query and if you need a csv you can always export it from a mysql admin took like phpmyadmin.

Agree... you should be using DBs for data management as much as possible. Learning curve isn't to steep and well worth the investment. Anything above 50K entries becomes unmanageable in Excel.

JFoulds · Jul 30, 2017

bk071 said:
And both excel / MySQL have their own advantages.

Excel has pretty much zero advantages over a relational database (eg, MySQL). Learn how, and use one.

bk071 · Jul 30, 2017

JFoulds said:
Excel has pretty much zero advantages over a relational database (eg, MySQL). Learn how, and use one.

That is subjective but I'm not advocating Excel here. At times, I do use Excel for quickly churning out charts and graphs.

Anyone good with selenium (python)?

bk071

Elite Member

Iamhere123

Newbie

bk071

Elite Member

Al Ali

Newbie

sirmeep

Registered Member

JFoulds

Power Member

bk071

Elite Member

Main Menu

Marketplace

Making Money

BlackHat World