文章詳情頁

python beautiful soup庫入門安裝教程

瀏覽：5日期：2022-08-06 18:29:08

目錄beautiful soup庫的安裝beautiful soup庫的理解beautiful soup庫的引用BeautifulSoup類回顧demo.htmlTag標(biāo)簽Tag的nameTag的attrs（屬性）Tag的NavigableStringHTML基本格式標(biāo)簽樹的下行遍歷標(biāo)簽樹的上行遍歷標(biāo)簽的平行遍歷bs庫的prettify()方法bs4庫的編碼beautiful soup庫的安裝

pip install beautifulsoup4beautiful soup庫的理解

beautiful soup庫是解析、遍歷、維護(hù)“標(biāo)簽樹”的功能庫

beautiful soup庫的引用

from bs4 import BeautifulSoupimport bs4BeautifulSoup類

BeautifulSoup對應(yīng)一個HTML/XML文檔的全部內(nèi)容

回顧demo.html

import requestsr = requests.get('http://python123.io/ws/demo.html')demo = r.textprint(demo)

<html><head><title>This is a python demo page</title></head><body>The demo python introduces several python courses.Python is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:<a id='link1'>Basic Python</a> and <a id='link2'>Advanced Python</a>.</body></html>Tag標(biāo)簽

基本元素說明 Tag 標(biāo)簽，最基本的信息組織單元，分別用<>和</>標(biāo)明開頭和結(jié)尾

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')print(soup.title)tag = soup.aprint(tag)

<title>This is a python demo page</title><a >Basic Python</a>

任何存在于HTML語法中的標(biāo)簽都可以用soup.訪問獲得。當(dāng)HTML文檔中存在多個相同對應(yīng)內(nèi)容時(shí)，soup.返回第一個

Tag的name

基本元素說明 Name 標(biāo)簽的名字，

…

的名字是’p’,格式：.name

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')print(soup.a.name)print(soup.a.parent.name)print(soup.a.parent.parent.name)

ap bodyTag的attrs（屬性）

基本元素說明 Attributes 標(biāo)簽的屬性，字典形式組織，格式：.attrs

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')tag = soup.aprint(tag.attrs)print(tag.attrs[’class’])print(tag.attrs[’href’])print(type(tag.attrs))print(type(tag))

{’href’: ’http://www.icourse163.org/course/BIT-268001’, ’class’: [’py1’], ’id’: ’link1’}[’py1’]http://www.icourse163.org/course/BIT-268001<class ’dict’><class ’bs4.element.Tag’>Tag的NavigableString

Tag的NavigableString

基本元素說明 NavigableString 標(biāo)簽內(nèi)非屬性字符串，<>…</>中字符串，格式：.string

Tag的Comment

基本元素說明 Comment 標(biāo)簽內(nèi)字符串的注釋部分，一種特殊的Comment類型

import requestsfrom bs4 import BeautifulSoupnewsoup = BeautifulSoup('This is not a comment','html.parser')print(newsoup.b.string)print(type(newsoup.b.string))print(newsoup.p.string)print(type(newsoup.p.string))

This is a comment<class ’bs4.element.Comment’>This is not a comment<class ’bs4.element.NavigableString’>HTML基本格式標(biāo)簽樹的下行遍歷

屬性說明 .contents 子節(jié)點(diǎn)的列表，將所有兒子結(jié)點(diǎn)存入列表 .children 子節(jié)點(diǎn)的迭代類型，與.contents類似，用于循環(huán)遍歷兒子結(jié)點(diǎn) .descendents 子孫節(jié)點(diǎn)的迭代類型，包含所有子孫節(jié)點(diǎn)，用于循環(huán)遍歷

BeautifulSoup類型是標(biāo)簽樹的根節(jié)點(diǎn)

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')print(soup.head)print(soup.head.contents)print(soup.body.contents)print(len(soup.body.contents))print(soup.body.contents[1])

<head><title>This is a python demo page</title></head>[<title>This is a python demo page</title>][’n’, The demo python introduces several python courses., ’n’, Python is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:<a >Basic Python</a> and <a >Advanced Python</a>., ’n’]5The demo python introduces several python courses.

for child in soup.body.children:print(child) #遍歷兒子結(jié)點(diǎn)for child in soup.body.descendants:print(child) #遍歷子孫節(jié)點(diǎn)標(biāo)簽樹的上行遍歷

屬性說明 .parent 節(jié)點(diǎn)的父親標(biāo)簽 .parents 節(jié)點(diǎn)先輩標(biāo)簽的迭代類型，用于循環(huán)遍歷先輩節(jié)點(diǎn)

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')print(soup.title.parent)print(soup.html.parent)

<head><title>This is a python demo page</title></head><html><head><title>This is a python demo page</title></head><body>The demo python introduces several python courses.Python is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:<a >Basic Python</a> and <a >Advanced Python</a>.</body></html>

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')for parent in soup.a.parents: if parent is None:print(parent) else:print(parent.name)

pbody html [document]標(biāo)簽的平行遍歷屬性說明 .next_sibling 返回按照HTML文本順序的下一個平行節(jié)點(diǎn)標(biāo)簽 .previous.sibling 返回按照HTML文本順序的上一個平行節(jié)點(diǎn)標(biāo)簽 .next_siblings 迭代類型，返回按照HTML文本順序的后續(xù)所有平行節(jié)點(diǎn)標(biāo)簽 .previous.siblings 迭代類型，返回按照HTML文本順序的前續(xù)所有平行節(jié)點(diǎn)標(biāo)簽

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')print(soup.a.next_sibling)print(soup.a.next_sibling.next_sibling)print(soup.a.previous_sibling)print(soup.a.previous_sibling.previous_sibling)print(soup.a.parent)

and <a id='link2'>Advanced Python</a>Python is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:NonePython is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:<a id='link1'>Basic Python</a> and <a id='link2'>Advanced Python</a>.

for sibling in soup.a.next_sibling:print(sibling) #遍歷后續(xù)節(jié)點(diǎn)for sibling in soup.a.previous_sibling:print(sibling) #遍歷前續(xù)節(jié)點(diǎn)

python beautiful soup庫入門安裝教程

bs庫的prettify()方法

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')print(soup.prettify())

<html> <head> <title> This is a python demo page </title> </head> <body> The demo python introduces several python courses. Python is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses: Basic Python </a> and <a id='link2'> Advanced Python </a> . </body></html>

.prettify()為HTML文本<>及其內(nèi)容增加更加’n’.prettify()可用于標(biāo)簽，方法：.prettify()

bs4庫的編碼

bs4庫將任何HTML輸入都變成utf-8編碼python 3.x默認(rèn)支持編碼是utf-8,解析無障礙

import requestsfrom bs4 import BeautifulSoupsoup = BeautifulSoup('中文','html.parser')print(soup.p.string)print(soup.p.prettify())

中文 中文

到此這篇關(guān)于python beautiful soup庫入門安裝教程的文章就介紹到這了,更多相關(guān)python beautiful soup庫入門內(nèi)容請搜索好吧啦網(wǎng)以前的文章或繼續(xù)瀏覽下面的相關(guān)文章希望大家以后多多支持好吧啦網(wǎng)！

Python 編程

上一條：Python BeautifulSoup基本用法詳解(通過標(biāo)簽及class定位元素)下一條：Python torch.flatten()函數(shù)案例詳解

相關(guān)文章：

1. jsp+servlet簡單實(shí)現(xiàn)上傳文件功能（保存目錄改進(jìn)）2. .Net反向代理組件Yarp用法詳解3. 解決request.getParameter取值后的if判斷為NULL的問題4. .NET Framework各版本(.NET2.0 3.0 3.5 4.0)區(qū)別5. 詳解JSP 內(nèi)置對象request常見用法6. JSP中param動作的實(shí)例詳解7. ASP.NET MVC實(shí)現(xiàn)下拉框多選8. ASP.NET MVC增加一條記錄同時(shí)添加N條集合屬性所對應(yīng)的個體9. .NET中的MassTransit分布式應(yīng)用框架詳解10. ASP.NET MVC實(shí)現(xiàn)本地化和全球化

排行榜

					
					Android 自定義View手寫簽名并保存圖片功能
Django實(shí)現(xiàn)自定義路由轉(zhuǎn)換器
python flask框架快速入門
JavaScript實(shí)現(xiàn)字符串與HTML格式相互轉(zhuǎn)換
Android中SeekBar拖動條使用方法詳解
python求numpy中array按列非零元素的平均值案例
PHP 5.0 的變化與PHP 6.0 展望
關(guān)于Python 解決Python3.9 pandas.read_excel(‘xxx.xlsx‘)報(bào)錯的問題
淺談Python 命令行參數(shù)argparse寫入圖片路徑操作
Aliyun Linux 編譯安裝 php7.3 tengine2.3.2 mysql8.0 redis5的過程詳解
thinkphp如何傳遞GET參數(shù)方法詳解
				