<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:content="http://purl.org/rss/1.0/modules/content/"><channel><title>Caddy on Ambertu</title><link>https://ambertu.com/tags/caddy/</link><description>Recent content in Caddy on Ambertu</description><generator>Hugo</generator><language>zh-CN</language><copyright>2026 Ambertu · 粤ICP备18071259号</copyright><lastBuildDate>Fri, 04 Sep 2026 00:00:00 +0000</lastBuildDate><atom:link href="https://ambertu.com/tags/caddy/index.xml" rel="self" type="application/rss+xml"/><item><title>Caddy 还是 nginx 给 API 中转做反代：证书自动化是决定性差异</title><link>https://ambertu.com/posts/caddy-vs-nginx-api-gateway-tls/</link><pubDate>Fri, 04 Sep 2026 00:00:00 +0000</pubDate><guid>https://ambertu.com/posts/caddy-vs-nginx-api-gateway-tls/</guid><description>反代能力上 Caddy 和 nginx 都够用，真正的分水岭是证书生命周期谁来管。对 API 中转站来说证书过期不是「用户看到警告」，而是所有 SDK 客户端硬失败的全站中断。本文含一个共享域名下 ACME 验证被吞掉的真实坑。</description><content:encoded><![CDATA[<p>给大模型 API 中转选反向代理，网上的对比文章大多在比性能、比配置语法、比模块生态。这些差异对一个 API 网关来说其实都不重要——<strong>真正的分水岭是证书生命周期由谁管理。</strong></p>
<p>原因很简单：对普通网站，证书过期是&quot;用户看到一个可怕的警告，但能点继续&quot;；对 API 网关，证书过期是<strong>所有客户端硬失败的全站中断</strong>。Python 的 <code>httpx</code>、<code>requests</code>、OpenAI SDK 全都会直接抛 <code>SSLError</code>，没有&quot;点继续&quot;这个选项。而且报错文本是 <code>certificate verify failed</code>，第一眼看着像客户端环境问题，会把人引到完全错误的方向排查。</p>
<h2 id="一张手动证书的真实时间线">一张手动证书的真实时间线</h2>
<p>我手上一台机器用的是 nginx 加商业 DV 证书（TrustAsia 签发），实测有效期：</p>
<div class="highlight"><pre tabindex="0" class="chroma"><code class="language-fallback" data-lang="fallback"><span class="line"><span class="cl">notBefore = Jun 18 08:00:00 2026 GMT
</span></span><span class="line"><span class="cl">notAfter  = Sep 16 07:59:59 2026 GMT
</span></span></code></pre></div><p>正好 90 天。查证书那天是 9 月 3 日，<strong>距到期 13 天</strong>。</p>
<p>这台机器上跑着 API 服务和一个静态站，证书是手工申请、手工安装的。它现在没坏，问题是<strong>它的存续完全依赖&quot;有人记得&quot;</strong>——记得到期日、记得去续、记得装上去、记得 reload。这三个月里只要有一次没记住，就是一次全站中断。</p>
<figure>
<svg viewBox="0 0 800 260" role="img" aria-label="对比图：手动证书在 90 天有效期末尾依赖人工记得续期，存在中断风险窗口；ACME 自动续期在生命周期约三分之二处自动更新，永远不会接近到期日" style="width:100%;height:auto;color:currentColor">
  <defs>
    <marker id="c1" viewBox="0 0 10 10" refX="9" refY="5" markerWidth="7" markerHeight="7" orient="auto">
      <path d="M 0 1 L 10 5 L 0 9 z" fill="currentColor"/>
    </marker>
  </defs>
  <text x="0" y="14" font-size="10.5" font-family="monospace" fill="currentColor" opacity="0.6">90 天证书生命周期</text>
  <!-- manual -->
  <text x="0" y="52" font-size="10.5" font-family="monospace" fill="currentColor">手动</text>
  <rect x="70" y="38" width="600" height="20" fill="none" stroke="currentColor" stroke-width="1.3"/>
  <rect x="583" y="38" width="87" height="20" fill="currentColor" opacity="0.22"/>
  <text x="70" y="76" font-size="9" font-family="monospace" fill="currentColor" opacity="0.65">签发</text>
  <text x="670" y="76" font-size="9" font-family="monospace" fill="currentColor" opacity="0.65" text-anchor="end">到期</text>
  <line x1="583" y1="90" x2="583" y2="62" stroke="currentColor" stroke-width="1.2" marker-end="url(#c1)"/>
  <text x="583" y="104" font-size="9.5" font-family="monospace" fill="currentColor" text-anchor="middle" font-weight="bold">今天 · 剩 13 天</text>
  <text x="676" y="52" font-size="9.5" font-family="monospace" fill="currentColor" font-weight="bold">⚠</text>
  <text x="70" y="122" font-size="9.5" font-family="monospace" fill="currentColor" opacity="0.75">灰色区间是风险窗口：全靠有人记得。忘一次 = 一次全站中断。</text>
  <line x1="0" y1="140" x2="780" y2="140" stroke="currentColor" stroke-width="1" opacity="0.2"/>
  <!-- auto -->
  <text x="0" y="180" font-size="10.5" font-family="monospace" fill="currentColor">ACME</text>
  <rect x="70" y="166" width="600" height="20" fill="none" stroke="currentColor" stroke-width="1.3"/>
  <line x1="470" y1="160" x2="470" y2="192" stroke="currentColor" stroke-width="1.4" stroke-dasharray="4 3"/>
  <text x="470" y="152" font-size="9.5" font-family="monospace" fill="currentColor" text-anchor="middle">约 2/3 处自动续期</text>
  <path d="M 470 202 L 560 202" stroke="currentColor" stroke-width="1.2" marker-end="url(#c1)" opacity="0.6"/>
  <text x="568" y="206" font-size="9.5" font-family="monospace" fill="currentColor" opacity="0.75">还有 30 天缓冲用于重试</text>
  <text x="70" y="232" font-size="9.5" font-family="monospace" fill="currentColor" opacity="0.75">永远不会接近右端。续期失败还有一个月时间告警和补救。</text>
</svg>
<figcaption>
两者的差别不是"自动比手动省事"，而是<strong>失败模式完全不同</strong>：
手动方案的失败是静默的、突然的、全量的；ACME 方案即使续期失败，也还有约 30 天窗口留给告警和人工介入。
</figcaption>
</figure>
<p>顺带说一个正在发生的趋势，它会让手动方案越来越站不住：<strong>证书有效期正在被行业强制缩短。</strong> 按 CA/Browser Forum 已通过的决议，TLS 证书最长有效期会分阶段从原来的一年多压到 200 天、100 天，最终到 47 天量级。手动续期在一年一次的年代还算可行，压到两个月一次就必然出事——<strong>这不是效率问题，是可靠性问题。</strong></p>
<h2 id="两者的实际差异">两者的实际差异</h2>
<table>
	<thead>
			<tr>
					<th>维度</th>
					<th>Caddy</th>
					<th>nginx</th>
			</tr>
	</thead>
	<tbody>
			<tr>
					<td><strong>证书管理</strong></td>
					<td><strong>内置 ACME，默认自动申请与续期</strong></td>
					<td>本身不管，需要 certbot + 定时器</td>
			</tr>
			<tr>
					<td>反代能力</td>
					<td>够用</td>
					<td>够用</td>
			</tr>
			<tr>
					<td>流式 / SSE</td>
					<td>对 <code>text/event-stream</code> 默认刷新</td>
					<td>需显式关 <code>proxy_buffering</code> 和 <code>gzip</code></td>
			</tr>
			<tr>
					<td>复杂 rewrite / 正则路由</td>
					<td>能做，但表达力弱一些</td>
					<td><strong>更强，且久经考验</strong></td>
			</tr>
			<tr>
					<td>模块生态</td>
					<td>较小</td>
					<td><strong>大得多</strong></td>
			</tr>
			<tr>
					<td>配置语法</td>
					<td>Caddyfile，简洁</td>
					<td>熟悉的人多</td>
			</tr>
			<tr>
					<td>内存占用</td>
					<td>略高（Go 运行时）</td>
					<td>略低</td>
			</tr>
			<tr>
					<td>出网要求</td>
					<td><strong>需要能访问 ACME 目录</strong></td>
					<td>无</td>
			</tr>
	</tbody>
</table>
<p>看这张表要抓重点：<strong>除了第一行和最后一行，其余差异对一个 API 网关都不构成决策依据。</strong> 反代能力两边都够，性能差异在 LLM 场景里被上游生成耗时完全淹没——你的瓶颈是模型在想，不是代理在转发。</p>
<p>Caddy 的代价也要说清，别只看好处：</p>
<ul>
<li><strong>需要出网访问 ACME 目录。</strong> 内网隔离环境、或出网被严格管控的机器上，自动签发根本走不通，这时 Caddy 的核心优势直接消失。</li>
<li><strong><code>on_demand_tls</code> 是个陷阱。</strong> 配错了会给任意 Host 头签发证书，等于把签发配额敞开给别人刷。要用就必须配 <code>ask</code> 端点做白名单校验。</li>
<li><strong>复杂路由场景 nginx 更稳。</strong> 如果你已经有一大堆 nginx 的 <code>location</code> 规则和正则，重写成 Caddyfile 的风险可能高于收益。</li>
</ul>
<h2 id="不换-nginx-的话certbot-要配对">不换 nginx 的话，certbot 要配对</h2>
<p>大多数人的现实是 nginx 配置已经很复杂、不想动。那就把证书自动化补上，同样能解决问题：</p>
<div class="highlight"><pre tabindex="0" class="chroma"><code class="language-bash" data-lang="bash"><span class="line"><span class="cl"><span class="c1"># 首次签发。--deploy-hook 是关键，否则证书换了但 nginx 还在用内存里的旧的</span>
</span></span><span class="line"><span class="cl">certbot certonly <span class="se">\
</span></span></span><span class="line"><span class="cl">  --webroot -w /var/www/acme <span class="se">\
</span></span></span><span class="line"><span class="cl">  -d ambertu.com -d www.ambertu.com <span class="se">\
</span></span></span><span class="line"><span class="cl">  --deploy-hook <span class="s2">&#34;systemctl reload nginx&#34;</span>
</span></span><span class="line"><span class="cl">
</span></span><span class="line"><span class="cl"><span class="c1"># 确认自动续期的定时器真的在跑 —— 这一步很多人跳过</span>
</span></span><span class="line"><span class="cl">systemctl list-timers <span class="p">|</span> grep certbot
</span></span><span class="line"><span class="cl">
</span></span><span class="line"><span class="cl"><span class="c1"># 演练一次，别等到真到期才发现签发链路是坏的</span>
</span></span><span class="line"><span class="cl">certbot renew --dry-run
</span></span></code></pre></div><p>三个容易漏的点：</p>
<ul>
<li><strong><code>--deploy-hook</code> 不能省。</strong> 证书文件换了，但 nginx 不会自己重新读——不 reload 就等于没续。</li>
<li><strong><code>systemctl list-timers</code> 必须确认。</strong> certbot 的自动续期靠 systemd timer（或 cron），装了 certbot 不代表定时器启用了。</li>
<li><strong><code>--dry-run</code> 要定期跑。</strong> 签发链路可能因为 DNS 变更、防火墙调整、challenge 路径被占而悄悄失效，<code>--dry-run</code> 是唯一能提前发现的手段。</li>
</ul>
<h2 id="一个共享域名下的真实坑acme-验证被吞掉">一个共享域名下的真实坑：ACME 验证被吞掉</h2>
<p>这个坑值得单独讲，因为它只在&quot;一个域名下住着多个应用&quot;时出现，而这种架构相当常见。</p>
<p>HTTP-01 验证要求 <code>http://your-domain/.well-known/acme-challenge/&lt;token&gt;</code> 能被访问到。问题是：<strong>这个路径会命中哪个 <code>location</code>？</strong></p>
<figure>
<svg viewBox="0 0 820 300" role="img" aria-label="示意图：共享域名下 ACME 验证路径的两种命中情况。未加专用 location 时验证路径落入站点根目录并被静态站的 try_files 返回 404 或被部署脚本清除；加了专用 location 后验证路径指向独立稳定目录，签发成功" style="width:100%;height:auto;color:currentColor">
  <defs>
    <marker id="c2" viewBox="0 0 10 10" refX="9" refY="5" markerWidth="7" markerHeight="7" orient="auto">
      <path d="M 0 1 L 10 5 L 0 9 z" fill="currentColor"/>
    </marker>
  </defs>
  <text x="0" y="14" font-size="10.5" font-family="monospace" fill="currentColor" opacity="0.6">GET /.well-known/acme-challenge/TOKEN 会命中哪个 location？</text>
  <!-- bad -->
  <text x="0" y="46" font-size="10.5" font-family="monospace" fill="currentColor" opacity="0.6">❌ 没有专用 location</text>
  <g font-family="monospace" font-size="10" fill="currentColor">
    <rect x="0" y="58" width="130" height="36" fill="none" stroke="currentColor" stroke-width="1.3"/>
    <text x="65" y="80" text-anchor="middle">certbot</text>
    <line x1="130" y1="76" x2="196" y2="76" stroke="currentColor" stroke-width="1.2" marker-end="url(#c2)"/>
    <rect x="198" y="58" width="150" height="36" fill="none" stroke="currentColor" stroke-width="1.3"/>
    <text x="273" y="80" text-anchor="middle">nginx location /</text>
    <line x1="348" y1="76" x2="414" y2="76" stroke="currentColor" stroke-width="1.2" marker-end="url(#c2)"/>
    <text x="381" y="68" text-anchor="middle" font-size="8.5" opacity="0.65">try_files</text>
    <rect x="416" y="58" width="240" height="36" fill="currentColor" fill-opacity="0.1" stroke="currentColor" stroke-width="1.3"/>
    <text x="536" y="76" text-anchor="middle" font-size="9">站点根目录/.well-known/…</text>
    <text x="536" y="88" text-anchor="middle" font-size="8.5" opacity="0.7">文件不在这里</text>
    <line x1="656" y1="76" x2="700" y2="76" stroke="currentColor" stroke-width="1.2" marker-end="url(#c2)"/>
    <text x="712" y="80" font-weight="bold">404</text>
  </g>
  <text x="0" y="120" font-size="9.5" font-family="monospace" fill="currentColor" opacity="0.75">签发失败，报错只说"验证不通过"，不会告诉你是哪个 location 吃掉了请求。</text>
  <text x="0" y="138" font-size="9.5" font-family="monospace" fill="currentColor" opacity="0.75">即使把 webroot 指对了，下一次部署静态站又会把 .well-known 目录清掉。</text>
  <line x1="0" y1="156" x2="800" y2="156" stroke="currentColor" stroke-width="1" opacity="0.2"/>
  <!-- good -->
  <text x="0" y="188" font-size="10.5" font-family="monospace" fill="currentColor" opacity="0.6">✓ 加一个专用 location，指向独立目录</text>
  <g font-family="monospace" font-size="10" fill="currentColor">
    <rect x="0" y="200" width="130" height="36" fill="none" stroke="currentColor" stroke-width="1.3"/>
    <text x="65" y="222" text-anchor="middle">certbot</text>
    <line x1="130" y1="218" x2="196" y2="218" stroke="currentColor" stroke-width="1.2" marker-end="url(#c2)"/>
    <rect x="198" y="200" width="150" height="36" fill="currentColor" fill-opacity="0.1" stroke="currentColor" stroke-width="1.5"/>
    <text x="273" y="216" text-anchor="middle" font-size="8.5">location</text>
    <text x="273" y="229" text-anchor="middle" font-size="8">/.well-known/acme-challenge/</text>
    <line x1="348" y1="218" x2="414" y2="218" stroke="currentColor" stroke-width="1.2" marker-end="url(#c2)"/>
    <text x="381" y="210" text-anchor="middle" font-size="8.5" opacity="0.65">前缀更长</text>
    <rect x="416" y="200" width="240" height="36" fill="none" stroke="currentColor" stroke-width="1.3"/>
    <text x="536" y="218" text-anchor="middle" font-size="9">/var/www/acme/.well-known/…</text>
    <line x1="656" y1="218" x2="700" y2="218" stroke="currentColor" stroke-width="1.2" marker-end="url(#c2)"/>
    <text x="712" y="222" font-weight="bold">200</text>
  </g>
  <text x="0" y="262" font-size="9.5" font-family="monospace" fill="currentColor" opacity="0.75">前缀 location 更长，优先命中；目录独立于任何应用的部署产物，部署脚本碰不到它。</text>
  <text x="0" y="284" font-size="9.5" font-family="monospace" fill="currentColor" font-weight="bold">这个 location 必须在 80 端口的 server 块里 —— 别被 301 到 443 拦掉（见下）。</text>
</svg>
<figcaption>
共享域名下这个坑有两重：<strong>验证路径可能落到错误的目录，而正确的目录又可能被部署脚本清空。</strong>
一个指向独立目录的专用 <code>location</code> 同时解决两个问题。
</figcaption>
</figure>
<p>正确的配法：</p>
<div class="highlight"><pre tabindex="0" class="chroma"><code class="language-nginx" data-lang="nginx"><span class="line"><span class="cl"><span class="c1"># 80 端口的 server 块里 —— 顺序很重要
</span></span></span><span class="line"><span class="cl"><span class="k">server</span> <span class="p">{</span>
</span></span><span class="line"><span class="cl">    <span class="kn">listen</span> <span class="mi">80</span><span class="p">;</span>
</span></span><span class="line"><span class="cl">    <span class="kn">server_name</span> <span class="s">ambertu.com</span> <span class="s">www.ambertu.com</span><span class="p">;</span>
</span></span><span class="line"><span class="cl">
</span></span><span class="line"><span class="cl">    <span class="c1"># ACME 验证必须放在 301 之前，否则请求会被跳转走
</span></span></span><span class="line"><span class="cl">    <span class="kn">location</span> <span class="s">/.well-known/acme-challenge/</span> <span class="p">{</span>
</span></span><span class="line"><span class="cl">        <span class="kn">root</span> <span class="s">/var/www/acme</span><span class="p">;</span>
</span></span><span class="line"><span class="cl">    <span class="p">}</span>
</span></span><span class="line"><span class="cl">
</span></span><span class="line"><span class="cl">    <span class="kn">location</span> <span class="s">/</span> <span class="p">{</span>
</span></span><span class="line"><span class="cl">        <span class="kn">return</span> <span class="mi">301</span> <span class="s">https://</span><span class="nv">$host$request_uri</span><span class="p">;</span>
</span></span><span class="line"><span class="cl">    <span class="p">}</span>
</span></span><span class="line"><span class="cl"><span class="p">}</span>
</span></span></code></pre></div><p><strong>顺序是关键。</strong> 如果 80 端口的 server 块里只有一句 <code>return 301 https://...</code>，那么 ACME 的验证请求会被 301 走。Let&rsquo;s Encrypt 会跟随跳转到 443，所以这种情况有时也能成——但如果 443 上的 <code>location /</code> 又用 <code>try_files ... =404</code> 兜底，请求最终还是 404。加一个显式的前缀 <code>location</code> 才是确定的做法，不依赖跳转链路碰巧走对。</p>
<p>再说一遍那个连带的坑：<strong>验证目录要放在任何应用的部署产物之外。</strong> 如果你把 webroot 指向静态站的根目录，而部署脚本用的是 <code>rsync --delete</code> 式的镜像同步，<code>.well-known</code> 会在下一次发版时被删掉——证书在三个月后续期失败，而当时没有人会想起两个月前改过部署脚本。</p>
<h2 id="混合方案">混合方案</h2>
<p>如果 nginx 配置太复杂不想重写，但又想要自动证书，可以让 Caddy 只做 TLS 终止：</p>
<div class="highlight"><pre tabindex="0" class="chroma"><code class="language-fallback" data-lang="fallback"><span class="line"><span class="cl">外网 → Caddy :443（自动证书） → nginx :8080（全部现有路由逻辑） → 各应用
</span></span></code></pre></div><p>Caddyfile 简单到几行：</p>
<div class="highlight"><pre tabindex="0" class="chroma"><code class="language-caddyfile" data-lang="caddyfile"><span class="line"><span class="cl"><span class="gh">ambertu.com</span>, <span class="gh">www.ambertu.com</span> <span class="p">{</span>
</span></span><span class="line"><span class="cl">    <span class="k">reverse_proxy</span> <span class="n">127.0.0.1</span><span class="p">:</span><span class="mi">8080</span> <span class="p">{</span>
</span></span><span class="line"><span class="cl">        <span class="k">flush_interval</span> <span class="s">-1</span><span class="c1">          # 保住 SSE 流式
</span></span></span><span class="line"><span class="cl">        <span class="k">header_up</span> <span class="s">X-Real-IP</span> <span class="se">{remote_host}</span>
</span></span><span class="line"><span class="cl">    <span class="p">}</span>
</span></span><span class="line"><span class="cl"><span class="p">}</span>
</span></span></code></pre></div><p>代价是多一跳（本机回环，延迟可忽略），以及 nginx 那边要改成监听 8080 且信任来自本机的 <code>X-Real-IP</code>——这一步别搞错，否则所有客户端 IP 都会变成 <code>127.0.0.1</code>，按 IP 的限流会一起误伤。</p>
<h2 id="无论用哪个把到期日变成告警">无论用哪个：把到期日变成告警</h2>
<p>这是这篇文章最该带走的一条。<strong>再好的自动化也可能静默失效</strong>，所以到期监控是独立于方案选择的必需品：</p>
<div class="highlight"><pre tabindex="0" class="chroma"><code class="language-bash" data-lang="bash"><span class="line"><span class="cl"><span class="cp">#!/bin/sh
</span></span></span><span class="line"><span class="cl"><span class="c1"># /usr/local/bin/cert-expiry-check.sh</span>
</span></span><span class="line"><span class="cl"><span class="nv">DOMAIN</span><span class="o">=</span><span class="s2">&#34;</span><span class="si">${</span><span class="nv">1</span><span class="k">:-</span><span class="nv">ambertu</span><span class="p">.com</span><span class="si">}</span><span class="s2">&#34;</span>
</span></span><span class="line"><span class="cl"><span class="nv">THRESHOLD</span><span class="o">=</span><span class="m">20</span>
</span></span><span class="line"><span class="cl">
</span></span><span class="line"><span class="cl"><span class="nv">END</span><span class="o">=</span><span class="k">$(</span><span class="nb">echo</span> <span class="p">|</span> openssl s_client -connect <span class="s2">&#34;</span><span class="nv">$DOMAIN</span><span class="s2">:443&#34;</span> -servername <span class="s2">&#34;</span><span class="nv">$DOMAIN</span><span class="s2">&#34;</span> 2&gt;/dev/null <span class="se">\
</span></span></span><span class="line"><span class="cl">      <span class="p">|</span> openssl x509 -noout -enddate <span class="p">|</span> cut -d<span class="o">=</span> -f2<span class="k">)</span>
</span></span><span class="line"><span class="cl"><span class="o">[</span> -z <span class="s2">&#34;</span><span class="nv">$END</span><span class="s2">&#34;</span> <span class="o">]</span> <span class="o">&amp;&amp;</span> <span class="o">{</span> <span class="nb">echo</span> <span class="s2">&#34;无法获取证书：</span><span class="nv">$DOMAIN</span><span class="s2">&#34;</span><span class="p">;</span> <span class="nb">exit</span> 2<span class="p">;</span> <span class="o">}</span>
</span></span><span class="line"><span class="cl">
</span></span><span class="line"><span class="cl"><span class="nv">DAYS</span><span class="o">=</span><span class="k">$((</span> <span class="o">(</span> <span class="k">$(</span>date -d <span class="s2">&#34;</span><span class="nv">$END</span><span class="s2">&#34;</span> +%s<span class="k">)</span> <span class="o">-</span> <span class="k">$(</span>date +%s<span class="k">)</span> <span class="o">)</span> <span class="o">/</span> <span class="m">86400</span> <span class="k">))</span>
</span></span><span class="line"><span class="cl"><span class="nb">echo</span> <span class="s2">&#34;</span><span class="nv">$DOMAIN</span><span class="s2"> 证书剩余 </span><span class="nv">$DAYS</span><span class="s2"> 天（到期 </span><span class="nv">$END</span><span class="s2">）&#34;</span>
</span></span><span class="line"><span class="cl"><span class="o">[</span> <span class="s2">&#34;</span><span class="nv">$DAYS</span><span class="s2">&#34;</span> -lt <span class="s2">&#34;</span><span class="nv">$THRESHOLD</span><span class="s2">&#34;</span> <span class="o">]</span> <span class="o">&amp;&amp;</span> <span class="o">{</span> <span class="nb">echo</span> <span class="s2">&#34;低于 </span><span class="nv">$THRESHOLD</span><span class="s2"> 天，需要处理&#34;</span><span class="p">;</span> <span class="nb">exit</span> 1<span class="p">;</span> <span class="o">}</span>
</span></span><span class="line"><span class="cl"><span class="nb">exit</span> <span class="m">0</span>
</span></span></code></pre></div><p>两点设计考虑：</p>
<ul>
<li><strong>从外部探测，而不是读本地证书文件。</strong> 读文件只能证明&quot;磁盘上那份还有效&quot;，探端口才能证明&quot;nginx 实际吐出去的那份还有效&quot;。两者不一致正是&quot;续了但忘了 reload&quot;这个经典故障的样子。</li>
<li><strong>阈值设 20 天而不是 3 天。</strong> 要留出的不是&quot;续期需要的时间&quot;，而是&quot;发现问题、排查、找人、处理&quot;的时间。</li>
</ul>
<p>配个定时任务每天跑一次，非零退出就告警。这十几行东西能挡住的，是那种&quot;周末证书过期、周一早上所有客户端集体报 SSL 错误&quot;的事故。</p>
<h2 id="相关阅读">相关阅读</h2>
<ul>
<li><a href="/posts/llm-api-timeout-retry-double-billing/">大模型 API 中转的超时与重试：一次 504 可能让你双倍计费</a> —— 另一类会让全部请求一起失败的配置问题</li>
<li><a href="/posts/llm-api-sse-proxy-buffering/">反代把大模型 API 的 SSE 流式响应缓冲了：五个缓冲点与三层排查法</a> —— 换成 Caddy 后 SSE 的行为差异</li>
<li><a href="/posts/api-gateway-real-ip-ratelimit/">API 中转站的限流为什么不能信 X-Forwarded-For</a> —— 混合方案里 <code>X-Real-IP</code> 那一跳为什么必须配对</li>
</ul>
]]></content:encoded></item><item><title>反代把大模型 API 的 SSE 流式响应缓冲了：五个缓冲点与三层排查法</title><link>https://ambertu.com/posts/llm-api-sse-proxy-buffering/</link><pubDate>Thu, 03 Sep 2026 00:00:00 +0000</pubDate><guid>https://ambertu.com/posts/llm-api-sse-proxy-buffering/</guid><description>大模型 API 中转后流式输出变成一次性返回，首字节延迟等于整个生成时长？问题几乎不在应用。本文列出请求路径上真实存在的五个缓冲点，给出一套从应用往外逐层二分的排查方法。</description><content:encoded><![CDATA[<p>自建大模型 API 中转后最常见的故障是：<strong>后端明明是流式的，经过反向代理就变成一次性返回</strong>——客户端等十几秒没有任何输出，然后整段文字一次吐完。首字节延迟几乎等于整个生成时长，流式的意义全部丧失。</p>
<p>这个问题九成不在应用代码里，而在 <strong>nginx 的 <code>proxy_buffering</code> 默认是开启的</strong>。但真正麻烦的地方是：请求路径上会缓冲的地方不止 nginx 一个，实际有五个，而且<strong>其中一个是你用来排查的 curl 自己</strong>。如果不知道这一点，你会在错误的层上改半天配置。</p>
<h2 id="先分清-sse-和-websocket">先分清 SSE 和 WebSocket</h2>
<p>这是配置写错的根源。大模型 API 的流式输出用的是 <strong>SSE（Server-Sent Events）</strong>：一个普通的 HTTP 响应，<code>Content-Type: text/event-stream</code>，靠 chunked 编码持续往下写。<strong>它不涉及协议升级。</strong></p>
<p>而网上大量&quot;流式接口反代配置&quot;教程给的是 WebSocket 的写法：</p>
<div class="highlight"><pre tabindex="0" class="chroma"><code class="language-nginx" data-lang="nginx"><span class="line"><span class="cl"><span class="c1"># ❌ 这是 WebSocket 的配置，SSE 不需要，而且硬编码有害
</span></span></span><span class="line"><span class="cl"><span class="k">proxy_set_header</span> <span class="s">Upgrade</span> <span class="nv">$http_upgrade</span><span class="p">;</span>
</span></span><span class="line"><span class="cl"><span class="k">proxy_set_header</span> <span class="s">Connection</span> <span class="s">&#34;upgrade&#34;</span><span class="p">;</span>
</span></span></code></pre></div><p>问题出在第二行<strong>硬编码</strong>了 <code>&quot;upgrade&quot;</code>：它会给经过这个 location 的<strong>所有</strong>请求都带上 <code>Connection: upgrade</code>，包括根本没有 <code>Upgrade</code> 头的普通请求和 SSE 请求。<code>Connection</code> 是逐跳（hop-by-hop）首部，被这么滥用会破坏到上游的 keepalive，某些上游实现还会因此行为异常。</p>
<p>正确的写法是用 <code>map</code> 按客户端是否真的请求升级来取值：</p>
<div class="highlight"><pre tabindex="0" class="chroma"><code class="language-nginx" data-lang="nginx"><span class="line"><span class="cl"><span class="c1"># http 块内
</span></span></span><span class="line"><span class="cl"><span class="k">map</span> <span class="nv">$http_upgrade</span> <span class="nv">$connection_upgrade</span> <span class="p">{</span>
</span></span><span class="line"><span class="cl">    <span class="kn">default</span> <span class="s">upgrade</span><span class="p">;</span>
</span></span><span class="line"><span class="cl">    <span class="kn">&#39;&#39;</span>      <span class="s">close</span><span class="p">;</span>
</span></span><span class="line"><span class="cl"><span class="p">}</span>
</span></span><span class="line"><span class="cl">
</span></span><span class="line"><span class="cl"><span class="c1"># location 内
</span></span></span><span class="line"><span class="cl"><span class="k">proxy_http_version</span> <span class="mi">1</span><span class="s">.1</span><span class="p">;</span>
</span></span><span class="line"><span class="cl"><span class="k">proxy_set_header</span> <span class="s">Upgrade</span>    <span class="nv">$http_upgrade</span><span class="p">;</span>
</span></span><span class="line"><span class="cl"><span class="k">proxy_set_header</span> <span class="s">Connection</span> <span class="nv">$connection_upgrade</span><span class="p">;</span>
</span></span></code></pre></div><p>如果这个 location 只服务 SSE、完全没有 WebSocket，那更简单——两行都不要写，改成让 nginx 复用到上游的连接：</p>
<div class="highlight"><pre tabindex="0" class="chroma"><code class="language-nginx" data-lang="nginx"><span class="line"><span class="cl"><span class="k">proxy_http_version</span> <span class="mi">1</span><span class="s">.1</span><span class="p">;</span>
</span></span><span class="line"><span class="cl"><span class="k">proxy_set_header</span> <span class="s">Connection</span> <span class="s">&#34;&#34;</span><span class="p">;</span>
</span></span></code></pre></div><h2 id="请求路径上真实存在的五个缓冲点">请求路径上真实存在的五个缓冲点</h2>
<figure>
<svg viewBox="0 0 800 240" role="img" aria-label="从应用到客户端的请求路径上有五个缓冲点：应用是否调用 flush、nginx 的 proxy_buffering、nginx 的 gzip 压缩、CDN 层缓冲、以及客户端 curl 自身的输出缓冲" style="width:100%;height:auto;color:currentColor">
  <defs>
    <marker id="a1" viewBox="0 0 10 10" refX="9" refY="5" markerWidth="7" markerHeight="7" orient="auto">
      <path d="M 0 1 L 10 5 L 0 9 z" fill="currentColor"/>
    </marker>
  </defs>
  <text x="0" y="14" font-size="11" font-family="monospace" fill="currentColor" opacity="0.6">token 的流动方向 →</text>
  <g font-family="monospace" font-size="11.5" fill="currentColor">
    <rect x="0" y="42" width="118" height="42" fill="none" stroke="currentColor" stroke-width="1.3"/>
    <text x="59" y="68" text-anchor="middle">应用</text>
    <line x1="118" y1="63" x2="198" y2="63" stroke="currentColor" stroke-width="1.2" marker-end="url(#a1)"/>
    <rect x="200" y="42" width="118" height="42" fill="currentColor" fill-opacity="0.09" stroke="currentColor" stroke-width="1.3"/>
    <text x="259" y="68" text-anchor="middle">nginx</text>
    <line x1="318" y1="63" x2="398" y2="63" stroke="currentColor" stroke-width="1.2" marker-end="url(#a1)"/>
    <rect x="400" y="42" width="118" height="42" fill="none" stroke="currentColor" stroke-width="1.3" stroke-dasharray="4 3"/>
    <text x="459" y="62" text-anchor="middle">CDN</text>
    <text x="459" y="77" text-anchor="middle" font-size="9" opacity="0.6">若有</text>
    <line x1="518" y1="63" x2="598" y2="63" stroke="currentColor" stroke-width="1.2" marker-end="url(#a1)"/>
    <rect x="600" y="42" width="118" height="42" fill="none" stroke="currentColor" stroke-width="1.3"/>
    <text x="659" y="68" text-anchor="middle">客户端</text>
  </g>
  <g font-family="monospace" font-size="9.5" fill="currentColor">
    <text x="0" y="112" opacity="0.55">默认</text>
    <text x="0" y="130">看代码</text>
    <text x="0" y="158" opacity="0.55">开关</text>
    <text x="0" y="176">flusher.Flush()</text>
    <text x="200" y="112" opacity="0.55">默认</text>
    <text x="200" y="130" font-weight="bold">缓冲 ⚠ 主因</text>
    <text x="200" y="158" opacity="0.55">开关</text>
    <text x="200" y="176">proxy_buffering off</text>
    <text x="200" y="194">gzip off ← 第二个</text>
    <text x="400" y="112" opacity="0.55">默认</text>
    <text x="400" y="130">多数缓冲 ⚠</text>
    <text x="400" y="158" opacity="0.55">开关</text>
    <text x="400" y="176">控制台流式配置</text>
    <text x="600" y="112" opacity="0.55">默认</text>
    <text x="600" y="130">curl 自己缓冲 ⚠</text>
    <text x="600" y="158" opacity="0.55">开关</text>
    <text x="600" y="176">curl -N</text>
  </g>
  <line x1="0" y1="212" x2="780" y2="212" stroke="currentColor" stroke-width="1" opacity="0.2"/>
  <text x="0" y="232" font-size="10" font-family="monospace" fill="currentColor" opacity="0.6">共 5 个缓冲点：应用 flush · proxy_buffering · gzip · CDN · 客户端</text>
</svg>
<figcaption>nginx 那一格是灰底的，因为它同时贡献了两个缓冲点：<code>proxy_buffering</code> 和 <code>gzip</code>。<strong>最容易误导排查的是最右边那格</strong>——不加 <code>-N</code> 的 curl 自己会缓冲输出，你会以为是服务端问题。</figcaption>
</figure>
<p>第五个缓冲点最坑人，所以单独强调：<strong><code>curl</code> 默认会缓冲输出</strong>。用不带 <code>-N</code> 的 curl 去验证流式，看到的永远是&quot;一次性返回&quot;，无论服务端配得对不对。排查流式问题的第一条纪律是所有 curl 都加 <code>-N</code>（等价于 <code>--no-buffer</code>）。</p>
<h2 id="症状长什么样">症状长什么样</h2>
<figure>
<svg viewBox="0 0 720 180" role="img" aria-label="示意图：缓冲开启时客户端长时间无输出然后一次性收到全部内容；缓冲关闭时 token 从一开始就持续到达" style="width:100%;height:auto;color:currentColor">
  <text x="0" y="14" font-size="11" font-family="monospace" fill="currentColor" opacity="0.6">客户端收到数据的时间轴（示意）</text>
  <g font-family="monospace" font-size="10.5" fill="currentColor">
    <text x="0" y="48">缓冲开启</text>
    <line x1="130" y1="52" x2="660" y2="52" stroke="currentColor" stroke-width="1" opacity="0.25"/>
    <rect x="560" y="38" width="100" height="18" fill="currentColor" opacity="0.75"/>
    <text x="130" y="76" opacity="0.6">↑ 全程无输出 ——————————————————→ 一次吐完</text>
    <text x="0" y="118">缓冲关闭</text>
    <line x1="130" y1="122" x2="660" y2="122" stroke="currentColor" stroke-width="1" opacity="0.25"/>
    <rect x="140" y="108" width="14" height="18" fill="currentColor" opacity="0.75"/>
    <rect x="162" y="108" width="14" height="18" fill="currentColor" opacity="0.75"/>
    <rect x="184" y="108" width="14" height="18" fill="currentColor" opacity="0.75"/>
    <rect x="206" y="108" width="14" height="18" fill="currentColor" opacity="0.75"/>
    <rect x="228" y="108" width="14" height="18" fill="currentColor" opacity="0.75"/>
    <rect x="250" y="108" width="14" height="18" fill="currentColor" opacity="0.75"/>
    <rect x="272" y="108" width="14" height="18" fill="currentColor" opacity="0.75"/>
    <rect x="294" y="108" width="14" height="18" fill="currentColor" opacity="0.75"/>
    <rect x="316" y="108" width="14" height="18" fill="currentColor" opacity="0.75"/>
    <rect x="338" y="108" width="14" height="18" fill="currentColor" opacity="0.75"/>
    <rect x="360" y="108" width="14" height="18" fill="currentColor" opacity="0.75"/>
    <rect x="382" y="108" width="14" height="18" fill="currentColor" opacity="0.75"/>
    <text x="140" y="146" opacity="0.6">↑ 首字节很快，token 持续到达</text>
  </g>
  <text x="0" y="174" font-size="10" font-family="monospace" fill="currentColor" opacity="0.6">本图为示意，非实测数据</text>
</svg>
<figcaption>判据不是"感觉慢"，而是一个可量化的信号：<strong>首字节时间约等于总时长</strong>。下一节给出怎么量。</figcaption>
</figure>
<p>用 curl 的计时字段可以把这件事量化，不用凭感觉：</p>
<div class="highlight"><pre tabindex="0" class="chroma"><code class="language-bash" data-lang="bash"><span class="line"><span class="cl">curl -N -o /dev/null -s <span class="se">\
</span></span></span><span class="line"><span class="cl">  -w <span class="s2">&#34;首字节 %{time_starttransfer}s / 总计 %{time_total}s\n&#34;</span> <span class="se">\
</span></span></span><span class="line"><span class="cl">  -H <span class="s2">&#34;Authorization: Bearer </span><span class="nv">$KEY</span><span class="s2">&#34;</span> <span class="se">\
</span></span></span><span class="line"><span class="cl">  -H <span class="s2">&#34;Content-Type: application/json&#34;</span> <span class="se">\
</span></span></span><span class="line"><span class="cl">  -d <span class="s1">&#39;{&#34;model&#34;:&#34;gpt-4o-mini&#34;,&#34;stream&#34;:true,&#34;messages&#34;:[{&#34;role&#34;:&#34;user&#34;,&#34;content&#34;:&#34;数到二十&#34;}]}&#39;</span> <span class="se">\
</span></span></span><span class="line"><span class="cl">  https://your-domain/v1/chat/completions
</span></span></code></pre></div><ul>
<li><code>首字节 ≈ 总计</code> → 被完整缓冲了</li>
<li><code>首字节 ≪ 总计</code> → 流式正常</li>
</ul>
<p>另一个免费信号在响应头里：</p>
<div class="highlight"><pre tabindex="0" class="chroma"><code class="language-bash" data-lang="bash"><span class="line"><span class="cl">curl -N -D - -o /dev/null -s ... <span class="p">|</span> grep -iE <span class="s1">&#39;content-length|transfer-encoding|content-type&#39;</span>
</span></span></code></pre></div><p><strong>出现 <code>Content-Length</code> 就说明响应被完整缓冲过</strong>——只有知道全部长度才能写出这个头。正常流式应该是 <code>Transfer-Encoding: chunked</code>（HTTP/1.1）或 HTTP/2 的分帧，加上 <code>Content-Type: text/event-stream</code>。</p>
<h2 id="三层二分排查法">三层二分排查法</h2>
<p>不要直接去猜哪一层，按下面这棵树走，两三条命令就能定位。核心思路是<strong>从最里层往外逐层加一跳</strong>，第一次出问题的那跳就是元凶。</p>
<figure>
<svg viewBox="0 0 780 350" role="img" aria-label="排查决策树：先用 curl -N 直连应用确认后端本身流式，再经 nginx，再经 CDN，每一步不流式就定位到该层" style="width:100%;height:auto;color:currentColor">
  <defs>
    <marker id="a2" viewBox="0 0 10 10" refX="9" refY="5" markerWidth="7" markerHeight="7" orient="auto">
      <path d="M 0 1 L 10 5 L 0 9 z" fill="currentColor"/>
    </marker>
  </defs>
  <g font-family="monospace" font-size="10.5" fill="currentColor">
    <rect x="180" y="14" width="270" height="38" fill="none" stroke="currentColor" stroke-width="1.3"/>
    <text x="315" y="31" text-anchor="middle">① curl -N 直连 127.0.0.1:3000</text>
    <text x="315" y="45" text-anchor="middle" opacity="0.6">绕过全部反代</text>
    <line x1="200" y1="52" x2="120" y2="88" stroke="currentColor" stroke-width="1.2" marker-end="url(#a2)"/>
    <text x="140" y="74" text-anchor="end" opacity="0.75">不流式</text>
    <rect x="10" y="90" width="200" height="38" fill="currentColor" fill-opacity="0.09" stroke="currentColor" stroke-width="1.3"/>
    <text x="110" y="107" text-anchor="middle">应用没有 flush</text>
    <text x="110" y="121" text-anchor="middle" opacity="0.6">改代码，见下节</text>
    <line x1="360" y1="52" x2="430" y2="88" stroke="currentColor" stroke-width="1.2" marker-end="url(#a2)"/>
    <text x="404" y="74" opacity="0.75">流式 ✓</text>
    <rect x="330" y="90" width="270" height="38" fill="none" stroke="currentColor" stroke-width="1.3"/>
    <text x="465" y="107" text-anchor="middle">② curl -N 经 nginx（内网 IP）</text>
    <text x="465" y="121" text-anchor="middle" opacity="0.6">加上反代这一跳</text>
    <line x1="350" y1="128" x2="230" y2="164" stroke="currentColor" stroke-width="1.2" marker-end="url(#a2)"/>
    <text x="252" y="150" text-anchor="end" opacity="0.75">不流式</text>
    <rect x="60" y="166" width="230" height="52" fill="currentColor" fill-opacity="0.09" stroke="currentColor" stroke-width="1.3"/>
    <text x="175" y="183" text-anchor="middle">nginx 缓冲</text>
    <text x="175" y="197" text-anchor="middle" opacity="0.6">proxy_buffering / gzip</text>
    <text x="175" y="211" text-anchor="middle" opacity="0.6">最常见的一档</text>
    <line x1="520" y1="128" x2="570" y2="164" stroke="currentColor" stroke-width="1.2" marker-end="url(#a2)"/>
    <text x="548" y="150" opacity="0.75">流式 ✓</text>
    <rect x="450" y="166" width="270" height="38" fill="none" stroke="currentColor" stroke-width="1.3"/>
    <text x="585" y="183" text-anchor="middle">③ curl -N 经公网域名</text>
    <text x="585" y="197" text-anchor="middle" opacity="0.6">加上 CDN 这一跳</text>
    <line x1="480" y1="204" x2="400" y2="242" stroke="currentColor" stroke-width="1.2" marker-end="url(#a2)"/>
    <text x="420" y="228" text-anchor="end" opacity="0.75">不流式</text>
    <rect x="250" y="244" width="200" height="38" fill="currentColor" fill-opacity="0.09" stroke="currentColor" stroke-width="1.3"/>
    <text x="350" y="261" text-anchor="middle">CDN 在缓冲</text>
    <text x="350" y="275" text-anchor="middle" opacity="0.6">去控制台配流式</text>
    <line x1="650" y1="204" x2="680" y2="242" stroke="currentColor" stroke-width="1.2" marker-end="url(#a2)"/>
    <text x="670" y="228" opacity="0.75">流式 ✓</text>
    <rect x="530" y="244" width="240" height="52" fill="none" stroke="currentColor" stroke-width="1.3"/>
    <text x="650" y="261" text-anchor="middle">服务端没问题</text>
    <text x="650" y="275" text-anchor="middle" opacity="0.6">查客户端：漏了 -N，</text>
    <text x="650" y="289" text-anchor="middle" opacity="0.6">或 SDK 未开 stream</text>
  </g>
  <text x="0" y="330" font-size="10" font-family="monospace" fill="currentColor" opacity="0.6">每一步都必须带 -N，否则测的是 curl 自己的缓冲</text>
</svg>
<figcaption>这套方法的价值在于<strong>每次只增加一跳</strong>，所以定位是确定的，不需要靠猜。灰底的三个是终点结论。</figcaption>
</figure>
<h2 id="nginx-侧的完整配置">nginx 侧的完整配置</h2>
<div class="highlight"><pre tabindex="0" class="chroma"><code class="language-nginx" data-lang="nginx"><span class="line"><span class="cl"><span class="k">location</span> <span class="s">/v1/</span> <span class="p">{</span>
</span></span><span class="line"><span class="cl">    <span class="kn">proxy_pass</span> <span class="s">http://127.0.0.1:3000/v1/</span><span class="p">;</span>
</span></span><span class="line"><span class="cl">
</span></span><span class="line"><span class="cl">    <span class="c1"># 关掉响应缓冲 —— 解决问题的主开关
</span></span></span><span class="line"><span class="cl">    <span class="kn">proxy_buffering</span>    <span class="no">off</span><span class="p">;</span>
</span></span><span class="line"><span class="cl">    <span class="kn">proxy_request_buffering</span> <span class="no">off</span><span class="p">;</span>
</span></span><span class="line"><span class="cl">    <span class="kn">proxy_cache</span>        <span class="no">off</span><span class="p">;</span>
</span></span><span class="line"><span class="cl">
</span></span><span class="line"><span class="cl">    <span class="c1"># gzip 压缩也会攒数据，流式 location 里必须关
</span></span></span><span class="line"><span class="cl">    <span class="kn">gzip</span>               <span class="no">off</span><span class="p">;</span>
</span></span><span class="line"><span class="cl">
</span></span><span class="line"><span class="cl">    <span class="c1"># chunked 需要 HTTP/1.1；清空 Connection 让 nginx 复用上游连接
</span></span></span><span class="line"><span class="cl">    <span class="kn">proxy_http_version</span> <span class="mi">1</span><span class="s">.1</span><span class="p">;</span>
</span></span><span class="line"><span class="cl">    <span class="kn">proxy_set_header</span>   <span class="s">Connection</span> <span class="s">&#34;&#34;</span><span class="p">;</span>
</span></span><span class="line"><span class="cl">
</span></span><span class="line"><span class="cl">    <span class="c1"># 长生成会超过默认的 60s，放宽读超时
</span></span></span><span class="line"><span class="cl">    <span class="kn">proxy_read_timeout</span> <span class="s">600s</span><span class="p">;</span>
</span></span><span class="line"><span class="cl">    <span class="kn">proxy_send_timeout</span> <span class="s">600s</span><span class="p">;</span>
</span></span><span class="line"><span class="cl">
</span></span><span class="line"><span class="cl">    <span class="kn">proxy_set_header</span>   <span class="s">Host</span>      <span class="nv">$host</span><span class="p">;</span>
</span></span><span class="line"><span class="cl">    <span class="kn">proxy_set_header</span>   <span class="s">X-Real-IP</span> <span class="nv">$remote_addr</span><span class="p">;</span>
</span></span><span class="line"><span class="cl"><span class="p">}</span>
</span></span></code></pre></div><p>几个容易漏的点：</p>
<ul>
<li><strong><code>gzip off</code> 不是可选项。</strong> nginx 的 gzip 模块要攒够数据才能压缩，开着它等于重新引入缓冲。很多人只关了 <code>proxy_buffering</code> 就以为完事，结果症状减轻但没消失，就是 gzip 在作祟。</li>
<li><strong><code>proxy_read_timeout</code> 默认 60 秒。</strong> 长上下文生成很容易超，超了会收到截断的响应或 504，且现象酷似&quot;流式坏了&quot;。</li>
<li><strong><code>proxy_request_buffering off</code></strong> 管的是请求方向，上传大 prompt 时有用，和响应流式无关但顺手一起配。</li>
</ul>
<h3 id="不想改-nginx-配置用响应头">不想改 nginx 配置？用响应头</h3>
<p>如果你没有 nginx 的配置权限，或者不想为一个接口改全局配置，<strong>应用可以自己让 nginx 关掉缓冲</strong>——返回这个响应头：</p>
<div class="highlight"><pre tabindex="0" class="chroma"><code class="language-fallback" data-lang="fallback"><span class="line"><span class="cl">X-Accel-Buffering: no
</span></span></code></pre></div><p>nginx 识别这个头并对该响应禁用缓冲。这是 nginx 特有的机制，非常实用：<strong>开关从运维侧移到了应用侧</strong>，随代码走，不会因为换机器忘配而复发。</p>
<h2 id="caddy-侧">Caddy 侧</h2>
<p>Caddy 的 <code>reverse_proxy</code> 对 <code>text/event-stream</code> 会自动刷新，多数情况下开箱即用。如果确实需要强制：</p>
<div class="highlight"><pre tabindex="0" class="chroma"><code class="language-caddyfile" data-lang="caddyfile"><span class="line"><span class="cl"><span class="gh">your-domain.com</span> <span class="p">{</span>
</span></span><span class="line"><span class="cl">    <span class="k">reverse_proxy</span> <span class="n">127.0.0.1</span><span class="p">:</span><span class="mi">3000</span> <span class="p">{</span>
</span></span><span class="line"><span class="cl">        <span class="k">flush_interval</span> <span class="s">-1</span>
</span></span><span class="line"><span class="cl">    <span class="p">}</span>
</span></span><span class="line"><span class="cl"><span class="p">}</span>
</span></span></code></pre></div><p><code>flush_interval -1</code> 表示每次写入立即刷新。另外 Caddy 默认会对文本类型启用压缩，如果显式配了 <code>encode gzip</code>，记得把流式路径排除掉，理由和 nginx 的 <code>gzip off</code> 一样。</p>
<h2 id="应用侧反代配对了也可能不流式">应用侧：反代配对了也可能不流式</h2>
<p>如果排查树的第一步就不通过，那是应用自己没有 flush。反代关掉缓冲只是&quot;不主动攒&quot;，它没法把应用攒着不发的数据变出来。Go 里的标准写法：</p>
<div class="highlight"><pre tabindex="0" class="chroma"><code class="language-go" data-lang="go"><span class="line"><span class="cl"><span class="kd">func</span><span class="w"> </span><span class="nf">stream</span><span class="p">(</span><span class="nx">w</span><span class="w"> </span><span class="nx">http</span><span class="p">.</span><span class="nx">ResponseWriter</span><span class="p">,</span><span class="w"> </span><span class="nx">r</span><span class="w"> </span><span class="o">*</span><span class="nx">http</span><span class="p">.</span><span class="nx">Request</span><span class="p">)</span><span class="w"> </span><span class="p">{</span><span class="w">
</span></span></span><span class="line"><span class="cl"><span class="w">    </span><span class="nx">flusher</span><span class="p">,</span><span class="w"> </span><span class="nx">ok</span><span class="w"> </span><span class="o">:=</span><span class="w"> </span><span class="nx">w</span><span class="p">.(</span><span class="nx">http</span><span class="p">.</span><span class="nx">Flusher</span><span class="p">)</span><span class="w">
</span></span></span><span class="line"><span class="cl"><span class="w">    </span><span class="k">if</span><span class="w"> </span><span class="p">!</span><span class="nx">ok</span><span class="w"> </span><span class="p">{</span><span class="w">
</span></span></span><span class="line"><span class="cl"><span class="w">        </span><span class="nx">http</span><span class="p">.</span><span class="nf">Error</span><span class="p">(</span><span class="nx">w</span><span class="p">,</span><span class="w"> </span><span class="s">&#34;streaming unsupported&#34;</span><span class="p">,</span><span class="w"> </span><span class="nx">http</span><span class="p">.</span><span class="nx">StatusInternalServerError</span><span class="p">)</span><span class="w">
</span></span></span><span class="line"><span class="cl"><span class="w">        </span><span class="k">return</span><span class="w">
</span></span></span><span class="line"><span class="cl"><span class="w">    </span><span class="p">}</span><span class="w">
</span></span></span><span class="line"><span class="cl"><span class="w">
</span></span></span><span class="line"><span class="cl"><span class="w">    </span><span class="nx">w</span><span class="p">.</span><span class="nf">Header</span><span class="p">().</span><span class="nf">Set</span><span class="p">(</span><span class="s">&#34;Content-Type&#34;</span><span class="p">,</span><span class="w"> </span><span class="s">&#34;text/event-stream&#34;</span><span class="p">)</span><span class="w">
</span></span></span><span class="line"><span class="cl"><span class="w">    </span><span class="nx">w</span><span class="p">.</span><span class="nf">Header</span><span class="p">().</span><span class="nf">Set</span><span class="p">(</span><span class="s">&#34;Cache-Control&#34;</span><span class="p">,</span><span class="w"> </span><span class="s">&#34;no-cache&#34;</span><span class="p">)</span><span class="w">
</span></span></span><span class="line"><span class="cl"><span class="w">    </span><span class="nx">w</span><span class="p">.</span><span class="nf">Header</span><span class="p">().</span><span class="nf">Set</span><span class="p">(</span><span class="s">&#34;X-Accel-Buffering&#34;</span><span class="p">,</span><span class="w"> </span><span class="s">&#34;no&#34;</span><span class="p">)</span><span class="w"> </span><span class="c1">// 顺手把 nginx 也关掉</span><span class="w">
</span></span></span><span class="line"><span class="cl"><span class="w">
</span></span></span><span class="line"><span class="cl"><span class="w">    </span><span class="k">for</span><span class="w"> </span><span class="nx">chunk</span><span class="w"> </span><span class="o">:=</span><span class="w"> </span><span class="k">range</span><span class="w"> </span><span class="nx">chunks</span><span class="w"> </span><span class="p">{</span><span class="w">
</span></span></span><span class="line"><span class="cl"><span class="w">        </span><span class="nx">fmt</span><span class="p">.</span><span class="nf">Fprintf</span><span class="p">(</span><span class="nx">w</span><span class="p">,</span><span class="w"> </span><span class="s">&#34;data: %s\n\n&#34;</span><span class="p">,</span><span class="w"> </span><span class="nx">chunk</span><span class="p">)</span><span class="w">
</span></span></span><span class="line"><span class="cl"><span class="w">        </span><span class="nx">flusher</span><span class="p">.</span><span class="nf">Flush</span><span class="p">()</span><span class="w"> </span><span class="c1">// 少了这行，前面全白配</span><span class="w">
</span></span></span><span class="line"><span class="cl"><span class="w">    </span><span class="p">}</span><span class="w">
</span></span></span><span class="line"><span class="cl"><span class="w">    </span><span class="nx">fmt</span><span class="p">.</span><span class="nf">Fprint</span><span class="p">(</span><span class="nx">w</span><span class="p">,</span><span class="w"> </span><span class="s">&#34;data: [DONE]\n\n&#34;</span><span class="p">)</span><span class="w">
</span></span></span><span class="line"><span class="cl"><span class="w">    </span><span class="nx">flusher</span><span class="p">.</span><span class="nf">Flush</span><span class="p">()</span><span class="w">
</span></span></span><span class="line"><span class="cl"><span class="p">}</span><span class="w">
</span></span></span></code></pre></div><p>注意 <code>w.Header().Set</code> 必须在第一次 <code>Write</code> 之前调用，否则不生效——这是另一个安静失败的经典来源。</p>
<h2 id="相关阅读">相关阅读</h2>
<ul>
<li><a href="/posts/new-api-binary-vs-docker/">new-api 部署选型：2G 小内存机器上裸二进制比 Docker 省多少</a> —— 反代前面那一层，部署形态怎么选</li>
<li><a href="/posts/api-gateway-real-ip-ratelimit/">API 中转站的限流为什么不能信 X-Forwarded-For</a> —— 本文配置里那行 <code>X-Real-IP</code> 为什么不能省</li>
</ul>
]]></content:encoded></item></channel></rss>