The issues you list can probably be split into 2 main issues
- The host has a tendency to block unknown user agents, or user agents that claim to be a browser but are not
- Anything that requires client side rendering
I'd suppose both problems are more pertinent in 2023 than they were in 2012.
At web scale, the issue appears on at what point would you be required to use a headless browser when not using one in the first place e.g. if React is included/referenced. Perhaps some simple fingerprinting of JS files would do, IMO in reality the line is very blurry, so you either do or don't.
- The host has a tendency to block unknown user agents, or user agents that claim to be a browser but are not
- Anything that requires client side rendering
I'd suppose both problems are more pertinent in 2023 than they were in 2012.
At web scale, the issue appears on at what point would you be required to use a headless browser when not using one in the first place e.g. if React is included/referenced. Perhaps some simple fingerprinting of JS files would do, IMO in reality the line is very blurry, so you either do or don't.