Slack Graph Exporter is the quickest and cheapest way to export Slack user and message data in RDF graph form. Unlike using other products on the market, you don't need to configure ETL pipelines or the output format -- we have modeled the RDF output for you using established vocabularies.

The graph output can be used to generate vector embeddings and then power a hybrid Retrieval Augmented Generation (RAG) applications such as enterprise vector search, customer 360 or sentiment analysis.

The RDF data is provided both as N-Quads files in an S3 bucket and loaded into an Amazon Neptune triplestore instance.

External dependencies

This product requires an internet connection to deploy properly. The following packages are downloaded on deployment:

• https://s3.amazonaws.com/com.atomgraph.octopus/s3-neptune-rdf-loader-1.0.1-SNAPSHOT.jar 
• https://s3.amazonaws.com/com.atomgraph.octopus/slack-rdf-transformer-1.0.0-SNAPSHOT.jar 
• https://s3.amazonaws.com/com.atomgraph.octopus/xslt-rdf-transform-1.0.1-SNAPSHOT.jar 

These are lambda functions that transform data and load it into the Neptune instance.

IAM resources

The CloudFormation stack creates the following IAM resources:

• RDFBulkLoaderRole - for the Neptune loader lambda function
• BucketNotificationsHandler050a0587b7544547bf325f094a3db834Role - for S3 notifications
• RDFTransformerRole - for the data transformation lambda
• DeliveryStreamRole - for the Kinesis stream
• SlackExporterTaskRole - for ECS tasks
• SlackExporterExecutionRole - for ECS tasks
• SlackTaskRunnerTaskRole - for ECS tasks
• SlackTaskRunnerExecutionRole - for ECS tasks
• RDFBulkLoaderRoleDefaultPolicy - for Neptune loader lambda function
• BucketNotificationsHandler050a0587b7544547bf325f094a3db834RoleDefaultPolicy - for S3 notifications
• RDFTransformerRoleDefaultPolicy - for the data transformation lambda
• DeliveryStreamRoleDefaultPolicy - for the Kinesis stream
• SlackExporterTaskRoleDefaultPolicy - for ECS tasks
• SlackExporterExecutionRoleDefaultPolicy - for ECS tasks
• SlackTaskRunnerTaskRoleDefaultPolicy - for ECS tasks
• SlackTaskRunnerExecutionRoleDefaultPolicy - for ECS tasks