AWS Advanced Tier Services Partner Wavicle delivers data and analytics services built on AWS that help businesses turn growing volumes of data into insights that drive successful outcomes. Collaborating with ARC, Wavicle migrated ATPCO’s existing sales data exchange (SDE) platform from a 30-year old legacy system to AWS, converting it to a streaming event-driven architecture that enables flexible and efficient data management.
Wavicle took a phased approach to migration that started with building infrastructure and data pipelines in AWS. The solution leverages AWS Lambda functions that are orchestrated using AWS Step Functions. Most of the data is stored in Amazon Simple Storage Service (Amazon S3), and communication between processes is handled by fully managed Amazon Simple Queue Service (Amazon SQS). “AWS Lambda enabled us to easily embed business logic in the solution,” said Thackston. “We’re also able to make changes quickly without impacting the entire system.”
The new sales data exchange (SDE) powered by AWS provided ATPCO with a faster and more user-friendly and cost-effective data environment, benefiting both IT teams and business stakeholders. The solution’s technical architecture was the key to its efficiency, flexibility, and value.
The implementation uses an infrastructure-as-code model with Terraform, which enables the establishment of infrastructure in AWS whenever it is needed. This eliminates the manual labor involved in duplicating the infrastructure across various environments, thus reducing the time and effort necessary for modifications.
The architecture of the new system also provides flexibility through a three-layer approach that includes raw, standardized, and processed layers. Data from various providers, such as the Global Distribution System (GDS), airlines, and vendors, is easily sourced via the AWS Transfer Family using the Secure File Transfer Protocol (SFTP) server and stored in Amazon S3 buckets for future implementations. A highly decoupled data services architecture is built for each module, including ingestion, data protection, transaction processing, and file delivery, making it easy to scale and extend any service with less effort and overhead. All three data layers provide a strong foundation for various users to explore and build future data products as needed.
In addition, the transition from legacy systems to a cloud environment led to significant reductions in operational, maintenance, support, and compute costs. The move also reduced the need for specialized talent to support and maintain the legacy system. “As a result of this migration to a modern AWS-powered solution, we significantly enhanced ATPCO's ability to quickly respond to changing customer needs and laid the foundation for advanced capabilities like artificial intelligence," noted Naveen Bahatam, associate director at Wavicle Data Solutions.