Parsing the DOM with Python

  • Python
  • Gabriele Romanato

DOM parsing is a fundamental technique for analyzing and manipulating the content of HTML documents. Python offers several powerful libraries to simplify this operation, making it accessible even to beginners. In this article, we will examine how to use BeautifulSoup, a library from the bs4 package, to perform DOM parsing.

Installing BeautifulSoup

To use BeautifulSoup, you first need to install the library. You can do this by running the following command:

pip install beautifulsoup4

Additionally, we recommend installing lxml or html.parser to improve parsing performance.

pip install lxml

Parsing an HTML Document

Below is a Python code example for parsing an HTML document:

from bs4 import BeautifulSoup

# Example HTML
html_doc = """
<html>
  <head><title>Parsing Example</title></head>
  <body>
    <h1>Welcome!</h1>
    <p>This is a DOM parsing example with Python.</p>
  </body>
</html>
"""

# Parsing the HTML document
soup = BeautifulSoup(html_doc, 'html.parser')

# Accessing elements
print(soup.title.string)  # Output: Parsing Example
print(soup.h1.string)     # Output: Welcome!
print(soup.p.string)      # Output: This is a DOM parsing example with Python.

Accessing and Manipulating the DOM

BeautifulSoup enables easy access and manipulation of DOM elements. For example, you can search for elements by tag, CSS class, or ID:

# Search for an element by tag
print(soup.find('h1').string)

# Search for an element by class
html_doc = '''
<div class="content">Sample text</div>
'''
soup = BeautifulSoup(html_doc, 'html.parser')
print(soup.find(class_="content").string)

Conclusion

DOM parsing with Python is a simple and flexible process thanks to libraries like BeautifulSoup. Whether you are building a web scraper or analyzing HTML, this tool allows you to easily access the desired content. Try applying the techniques illustrated to explore the endless possibilities offered by DOM parsing.

Back to top