- Notifications
You must be signed in to change notification settings - Fork715
-
Hey! I just discovered your project, and it looks like a really cool Elasticsearch alternative. I've been using Elasticsearch for several years as the main search engine in our news site's admin portal backend. Is it possible to create a news index and search through content similar to how ES works? Our editors search news by titles, topics, authors, regions, and of course by content text. Could there be any potential issues with around 50 million documents? We typically import thousands of documents per hour, and indexing speed is very important for our workflow. |
BetaWas this translation helpful?Give feedback.
All reactions
Replies: 1 comment
-
Hi@sinitcin , Thanks for checking out OpenObserve and for your message. Yes, you can create a stream called "news" and search across titles, topics, authors, regions, and full content just like in Elasticsearch. O2 querying engine allows you to use SQL with full-text support, for example: One of the big advantages over ES is our dynamic schema evolution. When you ingest new documents, OpenObserve automatically detects and indexes new fields without any manual intervention or reindexing required. So if your team starts adding more parameters (like tags or timestamps) down the line, they'll just get picked up seamlessly. Regarding scale: Handling around 50 million documents shouldn't be an issue, especially with our partitioning and indexing features to keep things performant. To boost it further, you can leverage options like: Full-text search: For quick content and title searches. These can be applied per field to reduce query scan time. If you run into issues setting these up, feel free to share details in ourcommunity slack |
BetaWas this translation helpful?Give feedback.