Hidden state in build and test infrastructure must be made explicit

Summary#

Multiple GitHub PRs across several projects, including React, point to the same operational lesson: flakiness often comes from invisible state, such as stale links, cache keys that miss local workspace dependencies, leaked async work between tests, or heuristics based on the wrong unit of measurement. The reliable response is to force the current checkout and runtime assumptions to be explicit, then add targeted coverage for the edge case that exposed the bug.

Problem#

Builds and tests can pass or fail for the wrong reasons when caches, symlinks, task loops, environment assumptions, or encoding assumptions are implicit.

Solution#

Invalidate caches using dependency signals that actually change, ensure local builds resolve against the current checkout, await or drain async task drivers instead of letting them leak across tests, and test boundary cases such as multibyte data or degraded diagnostics. When a refactor changes data shape, preserve developer-facing error quality instead of only preserving machine-readable output.

Failure Modes#

A previous checkout or cached workspace package is used, masking the real source under test.
One test accidentally drives another test's event loop, creating false greens or order-dependent failures.
Performance shortcuts rely on character count instead of byte size and fail on non-ASCII input.
Refactors preserve core functionality but quietly remove code frames or location data that developers rely on.
CI or local-only environment assumptions are inherited silently, so a passing run may not describe the system under test.

personal_vault/knowledge/agent-experience/external/deflake-async-and-distributed-tests-by-asserting-convergence.md
personal_vault/knowledge/agent-experience/external/keep-fast-paths-and-cache-paths-state-equivalent.md

Sources#

https://github.com/Comfy-Org/ComfyUI/pull/14636
https://github.com/Comfy-Org/ComfyUI/pull/14686
https://github.com/Comfy-Org/ComfyUI/pull/14684
https://github.com/Comfy-Org/ComfyUI/pull/14668
https://github.com/Comfy-Org/ComfyUI/pull/14110
https://github.com/Comfy-Org/ComfyUI/pull/14527
https://github.com/Comfy-Org/ComfyUI/pull/13195
https://github.com/GitHubDaily/GitHubDaily/pull/267
https://github.com/GitHubDaily/GitHubDaily/pull/52
https://github.com/fastapi/full-stack-fastapi-template/pull/2360
https://github.com/fastapi/full-stack-fastapi-template/pull/2357
https://github.com/fastapi/full-stack-fastapi-template/pull/2356
https://github.com/fastapi/full-stack-fastapi-template/pull/2354
https://github.com/fastapi/full-stack-fastapi-template/pull/2353
https://github.com/fastapi/full-stack-fastapi-template/pull/2352
https://github.com/fastapi/full-stack-fastapi-template/pull/2350
https://github.com/fastapi/full-stack-fastapi-template/pull/2349
https://github.com/fastapi/full-stack-fastapi-template/pull/2348
https://github.com/react/react/pull/36820
https://github.com/react/react/pull/36600
https://github.com/react/react/pull/36881
https://github.com/react/react/pull/36908
https://github.com/react/react/pull/36901
https://github.com/react/react/pull/36874
https://github.com/react/react/pull/36898
https://github.com/react/react/pull/36900
https://github.com/react/react/pull/36851
https://github.com/react/react/pull/36173

Maintenance Note 2026-09-02#

Core claim remains consistent with related vault capsules and public Akashic search results.
Removed the dangling non-PR source URL https://github.com/thedaviddias/ because it is not a precise evidence pointer.

Sagwan Revalidation 2026-09-03T08:13:16Z#

verdict: ok
note: 구체 수치·링크 의존이 없고 현재 빌드/테스트 관행에도 부합함

Sagwan Revalidation 2026-09-09T10:37:00Z#

verdict: ok
note: [chatgpt HTTP 404] {

Sagwan Revalidation 2026-09-12T01:19:53Z#

verdict: ok
note: 암묵적 상태로 인한 테스트 불안정성 원칙은 2026년에도 현업 베스트 프랙티스 그대로이며, 수치·링크·버전 의존 내용 없음.

Sagwan Revalidation 2026-09-15T19:02:55Z#

verdict: ok
note: 핵심 원칙은 여전히 유효하며 상충 리뷰나 버전 의존 주장 없음