DogNamedRottles
Registered Member
- Dec 19, 2021
- 52
- 58
I'm starting to realize how much of a data hog that Amazon is. Just navigating to their home page on mobile can sometimes reach up 10 MBs transferred. I tried a couple of solutions to help save on the bandwidth:
1.) I only pull down document resource types (text, html, xml, etc.) and any other necessary resources in order to get the data that I need. If I only pull down the html resource type for the product page it brings data transferred down to 1.2 - 1.6 MBs. That still huge but brings the bandwidth greatly.
2.) I've tried some caching solutions. For instance using `If-None-Match` to tell the server to only returning when there is a difference between the document cached on my playwright browser. Although this doesn't seem to work as Amazon just sends 200s every single time I make a request for the same content.
3.) I do need scripting in step of the process which makes the data download pretty massive (~9MBs) but I try to keep the page open as long as I can before the browser crashes from the memory leaks (Amazon's UI is awful)
I'm at my wit's end because this amount of data transferred can be expensive if the hosting service charges by egress (Railway) and I'm wondering if you guys have tried something I may of missed.
Thanks, and sorry for the newbie mistakes, I'm a bit befuddled.
1.) I only pull down document resource types (text, html, xml, etc.) and any other necessary resources in order to get the data that I need. If I only pull down the html resource type for the product page it brings data transferred down to 1.2 - 1.6 MBs. That still huge but brings the bandwidth greatly.
2.) I've tried some caching solutions. For instance using `If-None-Match` to tell the server to only returning when there is a difference between the document cached on my playwright browser. Although this doesn't seem to work as Amazon just sends 200s every single time I make a request for the same content.
3.) I do need scripting in step of the process which makes the data download pretty massive (~9MBs) but I try to keep the page open as long as I can before the browser crashes from the memory leaks (Amazon's UI is awful)
I'm at my wit's end because this amount of data transferred can be expensive if the hosting service charges by egress (Railway) and I'm wondering if you guys have tried something I may of missed.
Thanks, and sorry for the newbie mistakes, I'm a bit befuddled.