You’re confusing form-encoded and JSON data here. request.POST[‘foo’] is for form-encoded data. You are posting raw JSON, so you should use request.body. received_json_data=json.loads(request.body)
The HTTPError carries the Response object with it: def get_url_fp(image_url, request_kwargs=None): response = requests.get(some_url, **request_kwargs) response.raise_for_status() return response.raw try: a = “http://example.com” fp = get_url_fp(a) except HTTPError as e: # Need to check its an 404, 503, 500, 403 etc. status_code = e.response.status_code
This means that requests is using socks as a proxy and that socks is not installed. Just run pip install pysocks
Good news: there is now a requests module that supports javascript: https://pypi.org/project/requests-html/ from requests_html import HTMLSession session = HTMLSession() r = session.get(‘http://www.yourjspage.com’) r.html.render() # this call executes the js in the page As a bonus this wraps BeautifulSoup, I think, so you can do things like r.html.find(‘#myElementID’).text which returns the content of the HTML element … Read more
It is in fact a little strange that the library has a blank page about end-user unit testing, while targeting user-friendliness and ease of use. There’s however an easy-to-use library by Dropbox, unsurprisingly called responses. Here is its intro post. It says they’ve failed to employ httpretty, while stating no reason of the fail, and … Read more
You want to pass in JSON encoded data. See the API documentation: Remember — All post bodies must be JSON encoded data (no form data). The requests library makes this trivially easy: headers = {“W-Token”: “Ilovemyboss”} data = [ { ‘url’: ‘/rest/shifts’, ‘params’: {‘user_id’: 0, ‘other_stuff’: ‘value’}, ‘method’: ‘post’, }, { ‘url’: ‘/rest/shifts’, ‘params’: {‘user_id’: … Read more
The requests library doesn’t support ftp:// links. To download a file from an FTP server you could use urlretrieve: import urllib.request urllib.request.urlretrieve(‘ftp://server/path/to/file’, ‘file’) # if you need to pass credentials: # urllib.request.urlretrieve(‘ftp://username:password@server/path/to/file’, ‘file’) Or urlopen: import shutil import urllib.request from contextlib import closing with closing(urllib.request.urlopen(‘ftp://server/path/to/file’)) as r: with open(‘file’, ‘wb’) as f: shutil.copyfileobj(r, f) Python … Read more
Yes, there is. Use requests.Session and it will do keep-alive by default. I guess I should include a quick example: import logging import requests logging.basicConfig(level=logging.DEBUG) s = requests.Session() s.get(‘http://httpbin.org/cookies/set/sessioncookie/123456789’) s.get(‘http://httpbin.org/cookies/set/anothercookie/123456789’) r = s.get(“http://httpbin.org/cookies”) print(r.text) You will note that these log message occur INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): httpbin.org DEBUG:requests.packages.urllib3.connectionpool:”GET /cookies/set/sessioncookie/123456789 HTTP/1.1″ 302 223 DEBUG:requests.packages.urllib3.connectionpool:”GET /cookies … Read more
Oddly enough, requests doesn’t have anything simple for this. You’ll have to iterate over the response and write those chunks to a file: response = requests.get(‘http://www.example.com/image.jpg’, stream=True) # Throw an error for bad status codes response.raise_for_status() with open(‘output.jpg’, ‘wb’) as handle: for block in response.iter_content(1024): handle.write(block) I usually just use urllib.urlretrieve(). It works, but if … Read more
This is because of different requests module installed by the OS and the python dependencies for your local installation. It can be solved by upgrading requests: pip install requests or pip3 install requests