python requests库 笔记

1. requests的一些方法

1.1 requests.request(请求)

参数解释:

method: get/post/head/put/delete

url

params: 请求的参数(定制http的参数)

data: 上传的数据：字典，字节流，类文件句柄

json: 上传的json数据

headers: 自定义http头

cookie: 发送额外的cookies(字典)，默认自动处理发送上一次的cookie

verify: 是否检验证书

源代码中的解释:

def request(method, url, **kwargs):
"""Constructs and sends a :class:`Request <Request>`.

:param method: method for the new :class:`Request` object.
:param url: URL for the new :class:`Request` object.
:param params: (optional) Dictionary or bytes to be sent in the query string for the :class:`Request`.
:param data: (optional) Dictionary, bytes, or file-like object to send in the body of the :class:`Request`.
:param json: (optional) json data to send in the body of the :class:`Request`.
:param headers: (optional) Dictionary of HTTP Headers to send with the :class:`Request`.
:param cookies: (optional) Dict or CookieJar object to send with the :class:`Request`.
:param files: (optional) Dictionary of ``'name': file-like-objects`` (or ``{'name': ('filename', fileobj)}``) for multipart encoding upload.
:param auth: (optional) Auth tuple to enable Basic/Digest/Custom HTTP Auth.
:param timeout: (optional) How long to wait for the server to send data
before giving up, as a float, or a :ref:`(connect timeout, read
timeout) <timeouts>` tuple.
:type timeout: float or tuple
:param allow_redirects: (optional) Boolean. Set to True if POST/PUT/DELETE redirect following is allowed.
:type allow_redirects: bool
:param proxies: (optional) Dictionary mapping protocol to the URL of the proxy.
:param verify: (optional) whether the SSL cert will be verified. A CA_BUNDLE path can also be provided. Defaults to ``True``.
:param stream: (optional) if ``False``, the response content will be immediately downloaded.
:param cert: (optional) if String, path to ssl client cert file (.pem). If Tuple, ('cert', 'key') pair.
:return: :class:`Response <Response>` object
:rtype: requests.Response

Usage::

>>> import requests
>>> req = requests.request('GET', 'http://httpbin.org/get')
<Response [200]>
"""

requests.get

参数：

url

其他参数和request的参数一样

requests.post

参数：

url

data

json

和request参数一样

其他方法请求方法

requests.head

requests.put

requests.delete

1.2 requests.Response(应答)

参数解释:

status_code: 状态码

headers: 应答的http头

json: 应答的json数据

text: 应答的unicode编码的文本

content: 应答的字节流

cookies: 应答的cookie数据

源代码中的解释

class Response(object):
"""The :class:`Response <Response>` object, which contains a
server's response to an HTTP request.
"""

__attrs__ = [
'_content', 'status_code', 'headers', 'url', 'history',
'encoding', 'reason', 'cookies', 'elapsed', 'request'
]

def __init__(self):
super(Response, self).__init__()

self._content = False
self._content_consumed = False

#: Integer Code of responded HTTP Status, e.g. 404 or 200.
self.status_code = None

#: Case-insensitive Dictionary of Response Headers.
#: For example, ``headers['content-encoding']`` will return the
#: value of a ``'Content-Encoding'`` response header.
self.headers = CaseInsensitiveDict()

#: File-like object representation of response (for advanced usage).
#: Use of ``raw`` requires that ``stream=True`` be set on the request.
# This requirement does not apply for use internally to Requests.
self.raw = None

#: Final URL location of Response.
self.url = None

#: Encoding to decode with when accessing r.text.
self.encoding = None

#: A list of :class:`Response <Response>` objects from
#: the history of the Request. Any redirect responses will end
#: up here. The list is sorted from the oldest to the most recent request.
self.history = []

#: Textual reason of responded HTTP Status, e.g. "Not Found" or "OK".
self.reason = None

#: A CookieJar of Cookies the server sent back.
self.cookies = cookiejar_from_dict({})

#: The amount of time elapsed between sending the request
#: and the arrival of the response (as a timedelta).
#: This property specifically measures the time taken between sending
#: the first byte of the request and finishing parsing the headers. It
#: is therefore unaffected by consuming the response content or the
#: value of the ``stream`` keyword argument.
self.elapsed = datetime.timedelta(0)

#: The :class:`PreparedRequest <PreparedRequest>` object to which this
#: is a response.
self.request = None

1.3 测试代码

# use_requests.py
import requests

def get_json():
r = requests.get('https://api.github.com/events')
print(r.status_code)
print(r.headers)
print(r.content)
print(r.text)
print(r.json())

def get_querystring():  # 传递两个字符串参数
url = 'http://httpbin.org/get'
params = {'qs1': 'value1', 'qs2': 'value2'} # 传递参数
r = requests.get(url, params=params)
print(r.status_code)
print(r.content.decode('utf-8'))

def get_custom_headers():   # 传递http头
url = 'http://httpbin.org/get'
headers = {'x-header1': 'value1', 'x-header2': 'value2'}
r = requests.get(url, headers=headers)
print(r.status_code)
print(r.content.decode('utf-8'))

def get_cookie():   # 测试cookie
headers = {'User-Agent': 'Chrome'}
url = 'http://www.douban.com'
r = requests.get(url, headers=headers)
print(r.status_code)
print(r.cookies)
print(r.cookies['bid'])

if __name__ == '__main__':
#get_json()
#get_querystring()
#get_custom_headers()
get_cookie()

2. requests的高级用法

2.1 Session

用一个回话内参数保持一致，且会重用TCP连接以提高性能。

2.2 SSL证书认证

开启、关闭、自定义CA证书

2.3 上传普通文件和复杂结构的文件

2.4 代理访问