HindsightFrom the builder

Introducing Hindsight Memlake: serving 100M Memories at <100ms p99 on object storage

Hindsight released version 1.0 along with Memlake, a new storage engine that keeps agent memory in an object storage bucket the user controls and is built for a billion memories and more. Memlake is part of Hindsight Enterprise and already runs most of Hindsight Cloud, while open-source Hindsight keeps Postgres as the default. Hindsight says recall on Postgres slowed as banks grew, from 7.0 queries per second at 33,000 memories to 1.9 at 164,000 on a 4-vCPU primary. With Memlake, write cost no longer grows with bank size, p99 recall drops to 74 milliseconds once fully cached, and retrieval quality held steady.

Changing the storage engine didn't cost retrieval quality.

Read the original

Saved . A shortened excerpt from the official blog; the original publisher retains authorship.

Show all