本文實(shí)例講述了python使用BeautifulSoup分析網(wǎng)頁(yè)信息的方法。分享給大家供大家參考。具體如下：
這段python代碼查找網(wǎng)頁(yè)上的所有鏈接，分析所有的span標(biāo)簽，并查找class包含titletext的span的內(nèi)容
#import the library used to query a website
import urllib2
#specify the url you want to query
url = "http://www.python.org"
#Query the website and return the html to the variable 'page'
page = urllib2.urlopen(url)
#import the Beautiful soup functions to parse the data returned from the website
from BeautifulSoup import BeautifulSoup
#Parse the html in the 'page' variable, and store it in Beautiful Soup format
soup = BeautifulSoup(page)
#to print the soup.head is the head tag and soup.head.title is the title tag
print soup.head
print soup.head.title
#to print the length of the page, use the len function
print len(page)
#create a new variable to store the data you want to find.
tags = soup.findAll('a')
#to print all the links
print tags
#to get all titles and print the contents of each title
titles = soup.findAll('span', attrs = { 'class' : 'titletext' })
for title in allTitles:
print title.contents
希望本文所述對(duì)大家的Python程序設(shè)計(jì)有所幫助。
