I see you are talking about C# built in tools.
I was talking about using and controlling headless browsers, as they are much faster, more suitable for this kind of project, and require less resources.
Search for headless browsers, find the most suitable, or the one you like the most. There are...