Repository files navigation

A custom-built full-text search engine in Go, with inverted indexed based on prefix trees (tries) and n-grams, with concurrent processing document. The engine handles tokenization, stemming, stop-word removal, and now even supports fuzzy search (partial words and typos).

Configuration files are located in./config/. Useconfig_prod_example.yaml as a template.

make tidy# Or manually:go mod tidy

The Wikipedia abstract dump can be downloaded from Dump example:https://dumps.wikimedia.your.org/enwiki/latest/enwiki-latest-abstract1.xml.gz. Extract the file and place it in the./data/ directory.

## Build and RunBuild the service:```bashmake build# Or manually:go build -o build/fts ./cmd/fts

Run the service (!Check the configuration file!):

make execute# Or manually:./build/fts --config=./config/config_local.yaml

#Test the trie implementationmake test-trie# Or manually:gotest -v ./internal/services/fts_trie -count=1#Test the key-value implementationmake test-kv# Or manually:gotest -v ./internal/services/fts_kv -count=1