KV cache

Memory storing key matrices and values to accelerate generation in transformers.