0
Les heaps mentent bien : déboguer une fuite mémoire dans vLLM.
https://mistral.ai/fr/news/debugging-memory-leak-in-vllm/(mistral.ai)A memory leak was suspected in vLLM, appearing only under specific conditions with disaggregated prefill/decode serving and graph compilation enabled. Initial debugging attempts with standard Python memory profilers like Memray failed to identify the source of the leak. The investigation then moved to Heaptrack, a more advanced tool, which showed that the heap memory was stable but the Resident Set Size (RSS) was increasing. This discrepancy suggested the leak was occurring outside the heap, likely in anonymous memory mappings managed directly by system calls, prompting a deeper dive into lower-level system analysis.
0 points•by will22•1 day ago
Comments (0)
No comments yet. Be the first to comment!
Have an account? Log in to join the discussion.