問題背景:

我有三個端，我希望當client端的請求斷掉後，gateway就會取消串流，繼而backend也會同步取消。

client.py:

import requests
response = requests.get("http://127.0.0.1:8000/G_stream", stream=True)
count = 0
with response as r:
    r.raise_for_status() 
    for chunk in r.iter_content(chunk_size=1024): 
        print(chunk.decode("utf-8", errors="ignore"), end="", flush=True)
        count += 1
        if count == 10:
            break

gateway.py

import requests
from fastapi import FastAPI
from fastapi.responses import StreamingResponse
import asyncio

app = FastAPI()


async def text_generator(response):
    with response as r:
        r.raise_for_status()  
        for chunk in r.iter_content(chunk_size=1): 
            if chunk:
                print(chunk.decode("utf-8", errors="ignore"), end="", flush=True)
                yield chunk.decode("utf-8", errors="ignore")
                await asyncio.sleep(0)


async def generate_stream():
    deresponse = requests.get("http://127.0.0.1:8001/B_stream", stream=True)
    response = StreamingResponse(
        text_generator(deresponse), media_type="text/event-stream"
    )

    return response


@app.get("/G_stream")
async def stream_text():
    output = await generate_stream()
    return output

backend.py:

from fastapi import FastAPI
from fastapi.responses import StreamingResponse
import asyncio

app = FastAPI()

async def text_generator():

    text = "Hello, this is a streaming example."
    for chunk in text:
        print(chunk)
        yield chunk
        await asyncio.sleep(0.2)  # 模擬每200毫秒傳輸一個字元

    print("done")


@app.get("/B_stream")
async def stream_text():
    response = StreamingResponse(text_generator(), media_type="text/event-stream")
    return response

目前我能夠當client停止後，gateway會收到socket.send() raised exception.的warnning，但我不知道在哪裡可以取得這個問題，然後想說如果catch到這個錯誤就能break後面的backend? 還是各位前輩有其他方式?