feat: switch cache to be memory size based#9

Open

AllllenLuo wants to merge 3 commits intomainfrom cache-new

+67-40

Commits on Nov 5, 2024

Update the lru cache in both client and server side to be size-based instead of entry-based
AllllenLuo
committed

Commits on Nov 19, 2024

Optimize the size-based memory to avoid redundant calculation of entry size
AllllenLuo
committed
Fix the bug of stucking after reaching cache limit
AllllenLuo
committed