Accelerating Semantic and Similar Search Functions for a Leading Legal Publisher

As a high-profile provider of legal information in Austria, MANZ needed a robust system to efficiently and intelligently search through an enormous database of legal documents. MANZ had developed an architecture that leveraged powerful technologies such as OpenSearch but wanted to ensure that its approach would meet its goals for speed and efficiency. In developing a new system to more efficiently manage and search huge volume of documents, MANZ had several challenges.

A lack of experience in vector databases was the first challenge. While MANZ boasts a seasoned IT team, it had minimal prior experience building or managing a vector database entirely on its own, particularly one capable of handling 50 million documents. To get the additional guidance on establishing such a database system, MANZ wanted to validate that its initial architecture draft would meet long-term demands. For example, rightsizing clusters was particularly challenging. Finally, a lack of experience with other very specialized technology products presented further obstacles. This was the reason that MANZ engaged tecRacer to help develop and implement the document search capabilities needed to take its business to the next level.

MANZ chose tecRacer Consulting, a 2023 AWS System Integrator Partner of the Year, to help the company overcome technical and operational challenges, particularly around implementing semantic search functionality on a large document base. tecRacer’s team focused on enabling MANZ to build a more customized and optimized in-house system. This approach ensured that MANZ could continue to innovate independently and maintain control over its infrastructure. The solution was designed to handle over 300 million documents efficiently, with the help of AWS products such as Amazon OpenSearch Service and Amazon Neptune. MANZ wanted to avoid significant performance issues that can result in prolonged query times, so tecRacer worked closely with them to optimize their infrastructure by:

• Correctly sizing the OpenSearch cluster: Ensuring that the cluster was appropriately sized to handle large-scale document searches efficiently.
• Optimizing index and shard functions: tecRacer assisted in refining how indexes and shards were configured, a critical factor in improving search speed.
• Fine-tuning queries: By improving the search query logic and structure, the performance was enhanced significantly.

To automate and streamline the deployment process, tecRacer delivered a production-ready setup using Terraform. This included automated deployment scripts for Amazon OpenSearch Service and Amazon Neptune Database, along with crucial configurations for backup and security roles. The integration of infrastructure as code (IaC) allowed MANZ to scale its infrastructure easily while maintaining consistent security and operational practices. Recognizing that MANZ lacked prior experience with AWS products such as OpenSearch and Amazon Neptune Database, tecRacer provided customized hands-on workshops covering deployment, usage, and best practices, enabling MANZ’s team to develop and manage its solution independently.