RE: Introducing the Hunnypot 🍯
You are viewing a single comment's thread:
That short term cache to keep the story consistent is slick, and it save cycles on a small box that's not meant for AI :)
As an accountant, I appreciate a good decoy, the fake .env genreates just enough believability to waste their time, chef kiss.
Curious, do you cap the cache by time only or size'?
0
0
0.000
Both actually, originally it was just by time, but after I made the post I added a cap of 1000 max_cache (env var, so can be adjusted) jut to prevent potential memory leaks since it's in mem cache and not a redis cache or anything.
Time cap plus a hard max is great, it save cycles on modest hardware. If the cAChe hits 1000, are you evicting oldest or LRU style to keep stories stable? Also thsi might help perf if TTL refresh on hit, else hot entries churn fast :)