urlparse – Tarik Billa

Is there a predefined class for URL in Python?

January 7, 2024 by Tarik

urlparse does encapsulate URLs into a class, called ParseResult, so it can be considered a factory function for these. Straight from the Python docs: >>> urlparse(‘http://www.cwi.nl:80/%7Eguido/Python.html’) ParseResult(scheme=”http”, netloc=”www.cwi.nl:80″, path=”/%7Eguido/Python.html”, params=””, query=”, fragment=””) If you desperately want a class called URL to encapsulate your URLs, use an alias (URL = urlparse.ParseResult) or create an adapter.

“No module named ‘urlparse'” but I’m not using urlparse

December 1, 2023 by Tarik

For python3 I have used from urllib.parse import urlparse instead of from urlparse import parse_qsl, urlparse and it works recommended doc : https://docs.python.org/3/library/urllib.parse.html

How do I remove a query string from URL using Python

September 24, 2023 by Tarik

import sys if sys.version_info.major == 3: from urllib.parse import urlencode, urlparse, urlunparse, parse_qs else: from urllib import urlencode from urlparse import urlparse, urlunparse, parse_qs url=”http://example.com/?a=text&q2=text2&q3=text3&q2=text4&b#q2=keep_fragment” u = urlparse(url) query = parse_qs(u.query, keep_blank_values=True) query.pop(‘q2’, None) u = u._replace(query=urlencode(query, True)) print(urlunparse(u)) Output: http://example.com/?a=text&q3=text3&b=#q2=keep_fragment

Best way to get query string from a URL in python?

August 26, 2023 by Tarik

You can make Query string using GET parameters like this request.GET.urlencode() This does not include the ? prefix, and it may not return the keys in the same order as in the original request.

Which should I be using: urlparse or urlsplit?

July 27, 2023 by Tarik

Directly from the docs you linked yourself: urllib.parse.urlsplit(urlstring, scheme=””, allow_fragments=True) This is similar to urlparse(), but does not split the params from the URL. This should generally be used instead of urlparse() if the more recent URL syntax allowing parameters to be applied to each segment of the path portion of the URL (see RFC … Read more

What are the URL parameters? (element at position #3 in urlparse result)

May 13, 2023 by Tarik

Wow… I was not aware of that, see example: >>> urlparse.urlparse(“http://some.page.pl/nothing.py;someparam=some;otherparam=other?query1=val1&query2=val2#frag”) ParseResult(scheme=”http”, netloc=”some.page.pl”, path=”/nothing.py”, params=”someparam=some;otherparam=other”, query=’query1=val1&query2=val2′, fragment=”frag”) And help(urlparse.urlparse): Help on function urlparse in module urlparse: urlparse(url, scheme=””, allow_fragments=True) Parse a URL into 6 components: <scheme>://<netloc>/<path>;<params>?<query>#<fragment> Return a 6-tuple: (scheme, netloc, path, params, query, fragment). Note that we don’t break the components up in smaller … Read more

How do you strip out the domain name from a URL in php?

April 18, 2023 by Tarik

parse_url turns a URL into an associative array: php > $foo = “http://www.example.com/foo/bar?hat=bowler&accessory=cane”; php > $blah = parse_url($foo); php > print_r($blah); Array ( [scheme] => http [host] => www.example.com [path] => /foo/bar [query] => hat=bowler&accessory=cane )

Python urlparse — extract domain name without subdomain

April 11, 2023 by Tarik

You probably want to check out tldextract, a library designed to do this kind of thing. It uses the Public Suffix List to try and get a decent split based on known gTLDs, but do note that this is just a brute-force list, nothing special, so it can get out of date (although hopefully it’s … Read more

How can I import urlparse in python-3? [duplicate]

February 26, 2023 by Tarik

The urlparse in Python 2.7.11 was renamed to urllib.parse in Python 3. So, if you have a code such from urlparse import urljoin, I suggest you change it to from urllib.parse import urljoin

How to extract a filename from a URL and append a word to it?

January 21, 2023 by Tarik

You can use urllib.parse.urlparse with os.path.basename: import os from urllib.parse import urlparse url = “http://photographs.500px.com/kyle/09-09-201315-47-571378756077.jpg” a = urlparse(url) print(a.path) # Output: /kyle/09-09-201315-47-571378756077.jpg print(os.path.basename(a.path)) # Output: 09-09-201315-47-571378756077.jpg Your URL might contain percent-encoded characters like %20 for space or %E7%89%B9%E8%89%B2 for “特色”. If that’s the case, you’ll need to unquote (or unquote_plus) them. You can also use … Read more