Better Vector Search for Long Documents: Chunking Inside Manticore Search

Manticore Search has introduced a new feature called 'auto-chunking' to improve vector search performance for long documents. This feature chunks large documents into smaller pieces, allowing for faster and more efficient search queries. The chunking process can be configured to optimize for different use cases, such as reducing memory usage or improving search query performance. Auto-chunking is now available in Manticore Search version 2.8.0, which also includes several other new features and improvements.