最近需要對(duì)節(jié)點(diǎn)到源站自己做個(gè)監(jiān)控,簡(jiǎn)單的ping可以檢測(cè)到一些東西,但是http請(qǐng)求的檢查也要進(jìn)行,于是就研究了下pycurl。
pycurl是個(gè)用c語(yǔ)言實(shí)現(xiàn)的python 庫(kù),雖然據(jù)說不是那么pythonic,但是卻很高效,它支持的協(xié)議居多:
1
|
supporting FTP, FTPS, HTTP, HTTPS, GOPHER, TELNET, DICT, FILE and LDAP. libcurl supports HTTPS certificates, HTTP POST, HTTP PUT, FTP uploading, kerberos, HTTP form based upload, proxies, cookies, user+password authentication, file transfer resume, http proxy tunneling and more! |
這一堆協(xié)議已經(jīng)很多了,我需要就是http一個(gè),相對(duì)urlib來說,這個(gè)庫(kù)可能更快些。
以下這個(gè)腳本是對(duì)某一個(gè)給定的url進(jìn)行檢查,并打印出http相應(yīng)碼,響應(yīng)大小,建立連接時(shí)間,準(zhǔn)備傳輸時(shí)間,傳輸?shù)谝粋€(gè)字節(jié)時(shí)間,完成時(shí)間。
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
|
#!/usr/bin/python # coding: UTF-8 import StringIO import pycurl import sys import os class Test: def __init__( self ): self .contents = '' def body_callback( self ,buf): self .contents = self .contents + buf def test_gzip(input_url): t = Test() #gzip_test = file("gzip_test.txt", 'w') c = pycurl.Curl() c.setopt(pycurl.WRITEFUNCTION,t.body_callback) c.setopt(pycurl.ENCODING, 'gzip' ) c.setopt(pycurl.URL,input_url) c.perform() http_code = c.getinfo(pycurl.HTTP_CODE) http_conn_time = c.getinfo(pycurl.CONNECT_TIME) http_pre_tran = c.getinfo(pycurl.PRETRANSFER_TIME) http_start_tran = c.getinfo(pycurl.STARTTRANSFER_TIME) http_total_time = c.getinfo(pycurl.TOTAL_TIME) http_size = c.getinfo(pycurl.SIZE_DOWNLOAD) print 'http_code http_size conn_time pre_tran start_tran total_time' print "%d %d %f %f %f %f" % (http_code,http_size,http_conn_time,http_pre_tran,http_start_tran,http_total_time) if __name__ = = '__main__' : input_url = sys.argv[ 1 ] test_gzip(input_url) |
腳本運(yùn)行效果
1
2
3
|
xu:~ / curl$ python pycurl_test.py http: / / daxuxu.info / http_code http_size conn_time pre_tran start_tran total_time 200 8703 0.748147 0.748170 1.632642 1.636552 |
pycurl 的一些響應(yīng)信息:
(參考: http://curl.haxx.se/libcurl/c/curl_easy_getinfo.html )
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
|
pycurl.NAMELOOKUP_TIME 域名解析時(shí)間 pycurl.CONNECT_TIME 遠(yuǎn)程服務(wù)器連接時(shí)間 pycurl.PRETRANSFER_TIME 連接上后到開始傳輸時(shí)的時(shí)間 pycurl.STARTTRANSFER_TIME 接收到第一個(gè)字節(jié)的時(shí)間 pycurl.TOTAL_TIME 上一請(qǐng)求總的時(shí)間 pycurl.REDIRECT_TIME 如果存在轉(zhuǎn)向的話,花費(fèi)的時(shí)間 pycurl.EFFECTIVE_URL pycurl.HTTP_CODE HTTP 響應(yīng)代碼 pycurl.REDIRECT_COUNT 重定向的次數(shù) pycurl.SIZE_UPLOAD 上傳的數(shù)據(jù)大小 pycurl.SIZE_DOWNLOAD 下載的數(shù)據(jù)大小 pycurl.SPEED_UPLOAD 上傳速度 pycurl.HEADER_SIZE 頭部大小 pycurl.REQUEST_SIZE 請(qǐng)求大小 pycurl.CONTENT_LENGTH_DOWNLOAD 下載內(nèi)容長(zhǎng)度 pycurl.CONTENT_LENGTH_UPLOAD 上傳內(nèi)容長(zhǎng)度 pycurl.CONTENT_TYPE 內(nèi)容的類型 pycurl.RESPONSE_CODE 響應(yīng)代碼 pycurl.SPEED_DOWNLOAD 下載速度 pycurl.SSL_VERIFYRESULT pycurl.INFO_FILETIME 文件的時(shí)間信息 pycurl.HTTP_CONNECTCODE HTTP 連接代碼 pycurl.HTTPAUTH_AVAIL pycurl.PROXYAUTH_AVAIL pycurl.OS_ERRNO pycurl.NUM_CONNECTS pycurl.SSL_ENGINES pycurl.INFO_COOKIELIST pycurl.LASTSOCKET pycurl.FTP_ENTRY_PATH |