In-memory Semantic caching for LLMs written in Rust