Bloom filters: the niche trick behind a 16× faster API – Blog – incident.io

10 points
1/21/1970
19 hours ago
by birdculture

Comments


sgarland

Wait until they find out that Postgres has native bloom filters [0].

0: https://www.postgresql.org/docs/current/bloom.html

17 hours ago

lawrjone

I'm on the team who built this, I don't understand how you think these would be used. We need to use a b-tree index to give us ordered results that we then filter by the bloom column, how would an index on the bloom filter column help if we need the ordering?

Context is we didn't think these would work, and did look quite closely. We may have missed something though.

13 hours ago

sgarland

Upon re-reading the article, I must apologize - you’re correct, the native bloom extension doesn’t help here. I misread the constraints.

With that, hopefully it doesn’t come across as insincere or groveling to say this is an extremely cool way to solve the problem!

5 hours ago

UltraSane

Splunk uses bloom filters to quickly skip buckets that don't contain keywords.

17 hours ago