html-agility-pack – Tarik Billa

Html Agility Pack – Problem selecting subnode

April 9, 2024 by Tarik

A few things that will help you when working with HtmlAgilityPack and XPath expressions. If run is an HtmlNode, then: run.SelectNodes(“//div[@class=”date”]”) Will will behave exactly like doc.DocumentNode.SelectNodes(“//div[@class=”date”]”) run.SelectNodes(“./div[@class=”date”]”) Will give you all the <div> nodes that are children of run node. It won’t search deeper, only at the very next depth level. run.SelectNodes(“.//div[@class=”date”]”) Will return … Read more

HtmlAgilityPack replace node

January 2, 2024 by Tarik

To create a new node, use the HtmlNode.CreateNode() factory method, do not use the constructor directly. This code should work out for you: var htmlStr = “<b>bold_one</b><strong>strong</strong><b>bold_two</b>”; var doc = new HtmlDocument(); doc.LoadHtml(htmlStr); var query = doc.DocumentNode.Descendants(“b”); foreach (var item in query.ToList()) { var newNodeStr = “<foo>bar</foo>”; var newNode = HtmlNode.CreateNode(newNodeStr); item.ParentNode.ReplaceChild(newNode, item); } Note … Read more

HtmlAgilityPack set node InnerText

December 26, 2023 by Tarik

Try code below. It select all nodes without children and filtered out script nodes. Maybe you need to add some additional filtering. In addition to your XPath expression this one also looking for leaf nodes and filter out text content of <script> tags. var nodes = doc.DocumentNode.SelectNodes(“//body//text()[(normalize-space(.) != ”) and not(parent::script) and not(*)]”); foreach (HtmlNode … Read more

Html Agility Pack. Load and scrape webpage

December 10, 2023 by Tarik

Much easier to use HtmlWeb. string Url = “http://something”; HtmlWeb web = new HtmlWeb(); HtmlDocument doc = web.Load(Url);

C# html agility pack get elements by class name

December 10, 2023 by Tarik

I got it: resultContent.DocumentNode.SelectNodes(“//div[contains(@class, ‘hello’)]”)

HtmlAgilityPack — Does close itself for some reason?

December 2, 2023 by Tarik

This is also reported in this workitem. It contains a suggested workaround from DarthObiwan. You can change this without recompiling. The ElementFlags list is a static property on the HtmlNode class. It can be removed with HtmlNode.ElementsFlags.Remove(“form”); before doing the document load

XPath wildcard in attribute value

November 22, 2023 by Tarik

Use the following expression: //span[contains(concat(‘ ‘, @class, ‘ ‘), ‘ amount ‘)] You could use contains on its own, but that would also match classes like someamount. Test the above expression on the following input: <root> <span class=”test amount blah”/> <span class=”amount test”/> <span class=”test amount”/> <span class=”amount”/> <span class=”someamount”/> </root> It will select the … Read more

Parsing HTML page with HtmlAgilityPack

September 20, 2023 by Tarik

There are a number of ways to select elements using the agility pack. Let’s assume we have defined our HtmlDocument as follows: string html = @”<TD class=texte width=””50%””> <DIV align=right>Name :<B> </B></DIV></TD> <TD width=””50%””> <INPUT class=box value=John maxLength=16 size=16 name=user_name> </TD> <TR vAlign=center>”; HtmlDocument htmlDoc = new HtmlDocument(); htmlDoc.LoadHtml(html); 1. Simple LINQ We could use … Read more

Grab all text from html with Html Agility Pack

August 11, 2023 by Tarik

XPATH is your friend 🙂 HtmlDocument doc = new HtmlDocument(); doc.LoadHtml(@”<html><body><p>foo <a href=”http://www.example.com”>bar</a> baz</p></body></html>”); foreach(HtmlNode node in doc.DocumentNode.SelectNodes(“//text()”)) { Console.WriteLine(“text=” + node.InnerText); }

HtmlAgilityPack – How to get the tag by Id?

August 7, 2023 by Tarik

If I understand correctly then: HtmlAgilityPack.HtmlDocument document2 = new HtmlAgilityPack.HtmlDocument(); document2.Load(@”C:\try.html”); string tag = document2.GetElementbyId(“yourid”).Name; string href = document2.GetElementbyId(“yourid”).GetAttributeValue(“href”, “”);