https://wilsonwu.me/en/tags/rpm/Recent content in Rpm on Wilson WuHugo -- 0.127.0en-USMon, 17 Aug 2026 00:00:00 +0000https://wilsonwu.me/en/blog/2026/envoy-ai-ratelimit/Mon, 17 Aug 2026 00:00:00 +0000https://wilsonwu.me/en/blog/2026/envoy-ai-ratelimit/For conventional HTTP APIs, limiting the number of requests per minute is usually enough. For large language model APIs, however, limiting only the request count is far from sufficient: one request may consume only a few dozen tokens, while another may consume tens of thousands. Therefore, a practical AI gateway usually needs to support all of the following: RPM (Requests Per Minute): the number of requests per minute. TPM (Tokens Per Minute): the number of tokens per minute.