How to analyze data with AWS QuickSight

This page describes the architecture needed to stream data from akenza to AWS QuickSight and how to set up a simple dashboard

Data Flow Architecture

In this tutorial we'll guide you through the process to set up the architecture below. In order to store data from akenza in an Amazon S3 bucket and use QuickSight for data analysis and report generation.

Target Architecture

Akenza Output connector

Set up a AWS Kinesis output connector as described here: How to send data to AWS Kinesis

AWS Kinesis Data Stream

Use the Data Stream created in the above mentioned tutorial.

AWS Data Firehose

Prerequisites

If you haven't already created an Amazon S3 data base with a bucket dedicated for this data flow, create one now. Following this chapter: How to analyze data with AWS QuickSight

Creating a Firehose Stream

Create a new firehose stream. When prompted, select Amazon Kinesis Data stream as Source and Amazon S3 as Destination. Continue to add a name for your stream.

Creating a firehose stream

As a next step browse for the previously created Kinesis data stream in Source settings. As well as the prepared S3 bucket in the Destination settings. You may also enable the New line delimiter option.

Now continue to create firehose stream.

Amazon S3

Create General purpose bucket

In your amazon S3 account create a new General purpose bucket. Add a name for your bucket. And consider to enable ACLs to later grant access rights for your QuickSight user to access data in this bucket.

AWS QuickSight

Start by creating an AWS QuickSight account. Ensure to deselect any optional subscription checkboxes. Grant access for QuickSight to the following services:

• IAM

• Amazon S3

  • select the relevant bucket

You may need to add additional permission policies to your aws-quicksight-service-role user to allow access to the S3 bucker. Ensure the following policies have been assigned in IAM:

• AWSQuickSightIAMPolicy

• AWSQuickSightS3Policy

Create Datasets

In Datasets create a New Dataset. Select S3 as data source and give it a name. Continue to upload a manifest file. You may use our sample file. Make sure to update the URIprefixes to match the files in your S3 bucket.

Create QuickSight data source

// Sample manifest file

{
    "fileLocations": [
        {
            "URIPrefixes": [
                "s3://akenza-quicksight-testing/2025/"
            ]
        }w
    ],
    "globalUploadSettings": {
        "format": "JSON"
    }
}

Create Analysis

In Analyses create a New Analysis selecting the dataset you just created. Continue with use in analysis and create a new sheet. You may then continue to create your analysis and publish the dashboard when completed.

Basic line chart