visit
https://s3.us-east-005.backblazeb2.com/Web-Scraping/Web-Scraping-Services/custom-business-intelligence-services/internet-scraping-vs-web-crawling-whats-the.html
These are crucial questions to respond to prior to devoting to an option. On that particular note, a very crucial variable to consider for scalability is concurrency-- the capacity to take care of several requests