Bloom filters: the niche trick behind a 16× faster API – Blog – incident.io
10 points
1/21/1970
19 hours ago
by birdculture
Comments
sgarland
17 hours ago
lawrjone
I'm on the team who built this, I don't understand how you think these would be used. We need to use a b-tree index to give us ordered results that we then filter by the bloom column, how would an index on the bloom filter column help if we need the ordering?
Context is we didn't think these would work, and did look quite closely. We may have missed something though.
13 hours ago
sgarland
Upon re-reading the article, I must apologize - you’re correct, the native bloom extension doesn’t help here. I misread the constraints.
With that, hopefully it doesn’t come across as insincere or groveling to say this is an extremely cool way to solve the problem!
5 hours ago
UltraSane
Splunk uses bloom filters to quickly skip buckets that don't contain keywords.
17 hours ago
Wait until they find out that Postgres has native bloom filters [0].
0: https://www.postgresql.org/docs/current/bloom.html