** make sure the development packages of libxml2 and libxslt are installed ** From the lxml documentation, assuming you are running a Debian-based distribution : sudo apt-get install libxml2-dev libxslt-dev python-dev For Debian based systems, it should be enough to install the known build dependencies of python-lxml or python3-lxml, e.g. sudo apt-get install build-dep python3-lxml
I have a suspicion that this is related to the parser that BS will use to read the HTML. They document is here, but if you’re like me (on OSX) you might be stuck with something that requires a bit of work: You’ll notice that in the BS4 documentation page above, they point out that … Read more
Since you’re on Ubuntu, don’t bother with those source packages. Just install those development packages using apt-get. apt-get install libxml2-dev libxslt1-dev python-dev If you’re happy with a possibly older version of lxml altogether though, you could try apt-get install python-lxml and be done with it. 🙂