[CHIA-1608] Use a cache eviction logic that matches our BlsCache usage pattern

[CHIA-1608] Use a cache eviction logic that matches our BlsCache usage pattern #434