Suitable for scraping paginated, dynamic sites? #5
Description
Thank you for this contribution to the world. I hope to use it for as many purposes as possible.
Could you comment on whether this sort of approach would be suitable for scraping details from dynamic web pages, as opposed to static pages, with pagination and so forth? Specifically, I am thinking of using it to scrape a real estate site with search results that likely span multiple pages, generated from a search / browse interface.
Apologies if it's undesirable to pose this question here as an 'issue' but there does not appear to be another place to do so (which may well be entirely deliberate!). Please feel free to close and or simply delete this entire issue if it's an undesired annoyance.