requests is basically a convenient wrapper around urllib (and 2,3 and other related libraries). You can import urljoin(), quote() from requests.compat, but this is essentially the same as using them directly from urllib and urlparse modules: >>> from requests.compat import urljoin, quote_plus >>> url = “http://some-address.com/api/” >>> term = ‘This is a test’ >>> urljoin(url, … Read more
First you have to get the cookies from your driver instance: cookies = driver.get_cookies() This returns cookie dictionaries for your session. Next, set those cookies in requests: s = requests.Session() for cookie in cookies: s.cookies.set(cookie[‘name’], cookie[‘value’])
After requests.get(), you can use r.content to extract the raw Byte-type content. r = requests.get(‘https://yourweb.com’, stream=True) r.content
Here’s some code that might help you out. Examples: Example 1 (auth): username=”user” token = ‘token’ login = requests.get(‘https://api.github.com/search/repositories?q=github+api’, auth=(username,token)) Example 2 (headers): headers = {‘Authorization’: ‘token ‘ + token} login = requests.get(‘https://api.github.com/user’, headers=headers) print(login.json()) Example 3 (delete repo): user=”username” repo = ‘some_repo’ # Delete this repo headers = {‘Authorization’: ‘token ‘ + token} login … Read more
This thing worked for me, just make sure whether these modules are installed or not, if not then install them, following are: pip install ndg-httpsclient pip install pyopenssl pip install pyasn1 It removed my SSLError: EOF occurred in violation of protocol (_ssl.c:590) error. Hope it helps.
Did you try to parse it with the json module? import json parsed = json.loads(response.content)
On OSX, using python 2.7.10 / requests 2.9.1 I only had to to install requestsusing its security setup: pip install requests[security] This installs pyOpenSSL, ndg-httpsclient and pyasn1. https://github.com/kennethreitz/requests/blob/master/setup.py#L70
The content of the file in question is included in the returned data. You are getting the full GitHub view of that file, not just the contents. If you want to download just the file, you need to use the Raw link at the top of the page, which will be (for your example): https://raw.githubusercontent.com/someguy/brilliant/master/somefile.txt … Read more
You should not exit your worker instance sys.exit(1) Furthermore you ‘re catching the wrong Error. What you could do for for example is: from requests.exceptions import ConnectionError try: r = requests.get(“http://example.com”, timeout=0.001) except ConnectionError as e: # This is the correct syntax print e r = “No response” In this case your program will continue, … Read more
Run in command prompt. pip list Check what version you have installed on your system if you have an old version. Try to uninstall the package… pip uninstall requests Try after to install it: pip install requests You can also test if pip does not do the job. easy_install requests