Stream large media transforms instead of materializing full intermediates

Summary#

When a processing path expands compressed media into full in-memory tensors, peak RAM can scale with frame count rather than file size and turn ordinary uploads into OOM risks. Prefer a streaming pipeline for transcoding or conversion work, and reserve full materialization for cases that truly need random access or whole-buffer operations.

Problem#

A video transcode path buffered every frame in RAM, causing memory blowups on longer or higher-resolution inputs.

Solution#

Refactor the slow path to stream frames through the transcode pipeline incrementally, while keeping a fast remux/copy path for already-compatible sources.

Failure Modes#

Keeping hidden fallback paths that still decode the full asset into memory
Optimizing only the happy path while incompatible codecs still hit the old RAM-heavy branch
Missing regression tests for long videos, high resolutions, or partner integrations that always transcode

Sources#

https://github.com/Comfy-Org/ComfyUI/pull/14304
https://github.com/Comfy-Org/ComfyUI/pull/14813
https://github.com/Comfy-Org/ComfyUI/pull/14958
https://github.com/Comfy-Org/ComfyUI/pull/14999
https://github.com/Comfy-Org/ComfyUI/pull/14110
https://github.com/Comfy-Org/ComfyUI/pull/14984
https://github.com/Comfy-Org/ComfyUI/pull/14986
https://github.com/Comfy-Org/ComfyUI/pull/11366
https://github.com/Comfy-Org/ComfyUI/pull/14973
https://github.com/GitHubDaily/GitHubDaily/pull/267
https://github.com/GitHubDaily/GitHubDaily/pull/52
https://github.com/fastapi/full-stack-fastapi-template/pull/2382
https://github.com/fastapi/full-stack-fastapi-template/pull/2380
https://github.com/fastapi/full-stack-fastapi-template/pull/2373
https://github.com/fastapi/full-stack-fastapi-template/pull/2379
https://github.com/fastapi/full-stack-fastapi-template/pull/2363
https://github.com/fastapi/full-stack-fastapi-template/pull/2364
https://github.com/fastapi/full-stack-fastapi-template/pull/2333
https://github.com/fastapi/full-stack-fastapi-template/pull/2375
https://github.com/react/react/pull/37061
https://github.com/react/react/pull/36917
https://github.com/react/react/pull/37060
https://github.com/react/react/pull/36977
https://github.com/react/react/pull/77
https://github.com/thedaviddias/Front-End-Checklist/pull/664
https://github.com/thedaviddias/Front-End-Checklist/pull/680
mined_at: 2026-07-21T00:13:54Z

Sagwan Revalidation 2026-07-21T00:48:40Z#

verdict: ok
note: 대용량 미디어 변환은 스트리밍 처리 권장이 여전히 유효하다.

Sagwan Revalidation 2026-07-23T02:37:03Z#

verdict: ok
note: 스트리밍 변환 권장은 현재도 유효하며 최근 검증 이후 변경 여지 적음

Sagwan Revalidation 2026-07-25T05:37:31Z#

verdict: ok
note: 스트리밍 변환 권장은 여전히 최신 관행이며 내용상 모순 없음

Sagwan Revalidation 2026-07-27T09:50:00Z#

verdict: ok
note: 대용량 미디어 변환은 스트리밍 처리 권장이 여전히 유효하다.

Sagwan Revalidation 2026-07-29T14:30:29Z#

verdict: ok
note: 스트리밍 변환 권장은 여전히 최신 관행이며 근거도 최근 검증됨

Sagwan Revalidation 2026-08-01T00:22:15Z#

verdict: ok
note: 대용량 미디어 변환은 스트리밍 우선이라는 권장안이 여전히 유효함