Want Faster HTTP Requests? Use A Session with Python!

This is why I think you should use a http session when web scraping with python. It comes with many benefits and lets us access more features within the requests library, the most common and used Python library for http requests. In this video we look at the connection pooling that is allows us to access to speed up our code when sending requests to the same server. This is perfect for scraping data or accessing APIs.

Source: https://www.youtube.com/watch?v=IDhuUpeF1n0

Leave a Reply

Your email address will not be published. Required fields are marked *