There is no immediate way to do so, but it’s not hard to do. You can get a CookieJar object from the session with session.cookies, and use pickle to store it to a file. A full example: import requests, pickle session = requests.session() # Make some calls with open(‘somefile’, ‘wb’) as f: pickle.dump(session.cookies, f) Loading … Read more
According to the docs, there’s a status_code property on the response-object. So you can do the following: if resp.status_code == 200: print (‘OK!’) else: print (‘Boo!’) EDIT: As others have pointed out, a simpler check would be if resp.ok: print (‘OK!’) else: print (‘Boo!’) if you want to consider all 2xx response codes and not … Read more
Educated guesses (mentioned above) are probably just a check for Content-Type header as being sent by server (quite misleading use of educated imho). For response header Content-Type: text/html the result is ISO-8859-1 (default for HTML4), regardless any content analysis (ie. default for HTML5 is UTF-8). For response header Content-Type: text/html; charset=utf-8 the result is UTF-8. … Read more
I think a more reliable way of closing a connection is to tell the sever explicitly to close it in a way compliant with HTTP specification: HTTP/1.1 defines the “close” connection option for the sender to signal that the connection will be closed after completion of the response. For example, Connection: close in either the … Read more
You can also use curlify to do this. $ pip install curlify … import curlify print(curlify.to_curl(r.request)) # r is the response object from the requests library.
This should help: import csv import requests CSV_URL = ‘http://samplecsvs.s3.amazonaws.com/Sacramentorealestatetransactions.csv’ with requests.Session() as s: download = s.get(CSV_URL) decoded_content = download.content.decode(‘utf-8’) cr = csv.reader(decoded_content.splitlines(), delimiter=”,”) my_list = list(cr) for row in my_list: print(row) Ouput sample: [‘street’, ‘city’, ‘zip’, ‘state’, ‘beds’, ‘baths’, ‘sq__ft’, ‘type’, ‘sale_date’, ‘price’, ‘latitude’, ‘longitude’] [‘3526 HIGH ST’, ‘SACRAMENTO’, ‘95838’, ‘CA’, ‘2’, ‘1’, ‘836’, … Read more
I believe all the existing answers contain the relevant information, but I would like to summarize. The response object that is returned by requests get and post operations contains two useful attributes: Response attributes response.text – Contains str with the response text. response.content – Contains bytes with the raw response content. You should choose one … Read more
It is not good solution but you can use directly string: r = requests.get(url, params=”format=json&key=site:dummy+type:example+group:wheel”) BTW: Code which convert payload to this string payload = { ‘format’: ‘json’, ‘key’: ‘site:dummy+type:example+group:wheel’ } payload_str = “&”.join(“%s=%s” % (k,v) for k,v in payload.items()) # ‘format=json&key=site:dummy+type:example+group:wheel’ r = requests.get(url, params=payload_str) EDIT (2020): You can also use urllib.parse.urlencode(…) with parameter … Read more
The only way I’m currently aware of for disabling proxies entirely is the following: Create a session Set session.trust_env to False Create your request using that session import requests session = requests.Session() session.trust_env = False response = session.get(‘http://www.stackoverflow.com’) This is based on this comment by Lukasa and the (limited) documentation for requests.Session.trust_env. Note: Setting trust_env … Read more
It’s not recommended to use verify = False in your organization’s environments. This is essentially disabling SSL verification. Sometimes, when you are behind a company proxy, it replaces the certificate chain with the ones of Proxy. Adding the certificates in cacert.pem used by certifi should solve the issue. I had similar issue. Here is what … Read more