Oct 26, 2020
Hi Dai, thanks for your response. I am not aware that Azure blocks web scrapers by default. I helped a customer project where this was not the case. Are you sure you are not blocked by the destination/web sites? See here also a guide how to do ethical scraping: https://finddatalab.com/ethicalscraping