Benjamin Lee 20a54aacd6 factor search tokenization out into a function ...

This ensures that the tokenization algorithm will remain in sync between
querying, indexing, and deindexing. The existing code had slightly
different behavior for querying, because it did not discard words with
>50 bytes. This was inconsequential, because >50 byte tokens are never
present in the index.

Signed-off-by: strawberry <strawberry@puppygock.gay>

2024-06-12 14:04:47 -04:00

..

account_data

dissolve key_value/*

2024-05-27 18:16:23 -04:00

appservice

Fix use-self

2024-06-09 20:06:50 +00:00

globals

split migrations function

2024-06-09 20:56:41 +00:00

key_backups

dissolve key_value/*

2024-05-27 18:16:23 -04:00

media

admin: media: Force flag on past media removal

2024-06-07 15:08:08 -04:00

presence

use debug_warn for presence spam

2024-06-07 02:00:28 +00:00

pusher

Fix futures not Send

2024-06-09 20:06:50 +00:00

rooms

factor search tokenization out into a function

2024-06-12 14:04:47 -04:00

sending

Fix use-self

2024-06-09 20:06:50 +00:00

transaction_ids

dissolve key_value/*

2024-05-27 18:16:23 -04:00

uiaa

add legacy element hack for UIAA using invalid user field

2024-06-06 10:57:00 -04:00

users

slightly dedupe pfp/displayname updates, update blurhash in PDUs too

2024-06-11 01:19:18 -04:00

admin.rs

Fix branches sharing code

2024-06-09 20:06:50 +00:00

Cargo.toml

add legacy element hack for UIAA using invalid user field

2024-06-06 10:57:00 -04:00

mod.rs

move services ctor/dtor detail into service

2024-06-06 18:21:40 +00:00

pdu.rs

Fix use-self

2024-06-09 20:06:50 +00:00

services.rs

eliminate RotationHandler

2024-06-07 02:00:28 +00:00