首页 › Python 实用脚本 › requests:发送 HTTP 请求

requests:发送 HTTP 请求

requests 是 Python 中最流行的 HTTP 库,用来调用网络接口、下载文件。

$ pip install requests

GET 请求

import requests

resp = requests.get("https://httpbin.org/get", params={"q": "python", "page": 1}, timeout=10)
print(resp.status_code)          # 200
print(resp.url)                  # 带参数的完整 URL
print(resp.headers["Content-Type"])
data = resp.json()               # 解析 JSON 响应
print(data["args"])

一定要设置 timeout,否则网络异常时程序可能一直卡住。

POST 请求

resp = requests.post("https://httpbin.org/post", json={"name": "小明", "age": 18}, timeout=10)
print(resp.json()["json"])

# 表单提交
resp = requests.post("https://httpbin.org/post", data={"user": "a", "pwd": "b"}, timeout=10)

请求头与会话

session = requests.Session()
session.headers.update({"User-Agent": "my-script/1.0"})
r1 = session.get("https://httpbin.org/cookies/set/token/abc", timeout=10)
r2 = session.get("https://httpbin.org/cookies", timeout=10)
print(r2.json())                 # 会话会自动保存 Cookie

错误处理

try:
    resp = requests.get("https://httpbin.org/status/404", timeout=5)
    resp.raise_for_status()      # 状态码 4xx/5xx 时抛出异常
except requests.HTTPError as e:
    print("HTTP 错误:", e)
except requests.RequestException as e:
    print("网络错误:", e)

下载大文件

url = "https://example.com/big.zip"
with requests.get(url, stream=True, timeout=30) as r:
    r.raise_for_status()
    with open("big.zip", "wb") as f:
        for chunk in r.iter_content(chunk_size=1024 * 64):
            f.write(chunk)

stream=True 表示边下边写,不会把整个文件读进内存。

访问网站时请遵守对方的使用条款和 robots.txt,控制请求频率,不要给别人的服务器造成压力。

练习题

学完本节后,试着独立完成下面的练习,再展开参考答案对照。

练习 1 请求 https://httpbin.org/get,带上参数 lang=python,输出服务器返回的参数。

查看参考答案
import requests
r = requests.get("https://httpbin.org/get", params={"lang": "python"}, timeout=10)
r.raise_for_status()
print(r.json()["args"])