Additional Dashboards

This guide requires that you’ve already deployed the Cloud Intelligence Dashboards.

1. Visit CloudShell in the account where you have deployed the Cloud Intelligence Dashboards
2. Run the following command and make sure you hit enter python3 -m ensurepip --upgrade
3. Run the following command and make sure you hit enter pip3 install --upgrade cid-cmd
4. Run the following command and make sure you hit enter cid-cmd deploy
5. Select the Trends dashboard and hit enter.
6. Follow any instructions in the command line tool.
7. Dashboard will deploy with a link.

The Data Transfer Dashboard is an interactive, customizable and accessible QuickSight dashboard to help customers gain insights into their data transfer. It will analyze any data transfer that incurs a cost such as outbound internet and regional data transfer from all services.

This dashboard contains data transfer breakdowns with the following visuals:

• Amount and cost by service and region
• Between regions
• Internet data transfer, AWS Global Accelerator usage details for estimation
• Regional Data transfer
• CloudFront cost and usage analysis

Authors

• Chaitanya Shah, Sr. Technical Account Manager

FAQ

The FAQ for this dashboard is here.

Introduction

The Data Transfer Dashboard is an interactive, customizable and accessible QuickSight dashboard to help customers gain insights into their data transfer. It will analyze any data transfer that incurs a cost such as outbound internet and regional data transfer from all services.

This dashboard contains data transfer breakdowns with the following visuals:

• Amount and cost by service and region
• Between regions
• Internet data transfer
• Regional Data transfer

Request Template Access

Ensure you have requested access to the Cost Intelligence template here.

Create Athena Views

The data source for the dashboard will be an Athena view of your existing Cost and Usage Report (CUR).

1. Login via SSO in your Cost Optimization account, go into the Athena console:

2. Create the Data Transfer view by modifying the following code, and executing it in Athena or using aws cli:

   • Data Transfer View

Create QuickSight Data Sets

We will now create the data sets in QuickSight from the Athena views.

1. Go to the QuickSight service homepage

2. Click on the Datasets and then click on New dataset

3. Click Athena

4. Enter a data source name of DataTransfer_Cost_Dashboard and click Create data source:

5. Select the costmaster database, and the data_transfer_view table, click Edit/Preview data:

6. Select SPICE to change your Query mode:

7. Click on region to get the drop down arrow and click on it, then hover over Change data type then select # String

8. Select Save & Publish and then Click on Cancel:

9. Select the data_transfer_view Data Set:

10. Click Schedule refresh:

11. Click Create:

12. Enter a schedule, it needs to be refreshed daily, and click Create:

13. Click Cancel to exit:

14. Click the x in the top corner:

Create the Dashboard

We will now use the CLI to create the dashboard from the Data Transfer Cost and Usage Analysis Dashboard template, then create an Analysis you can customize and modify in the next step.

1. If you have not requested access, go to this we page to request access to the template: Template Access

2. Edit the following command, replacing AccountID with your account ID, and region with the region you are working in, then using the CLI list the QuickSight datasets and copy the Name and Arn for the dataset: data_transfer_view:

    aws quicksight list-data-sets --aws-account-id (AccountID) --region (region)
   

    

    {
        "Arn": "arn:aws:quicksight:us-east-1:<your account id>:dataset/fc0cf1eb-173b-4aca-93b6-f58784637732",
        "DataSetId": "fc0cf1eb-173b-4aca-93b6-f58784637732",
        "Name": "data_transfer_view",
        "CreatedTime": "2020-08-09T23:06:41.666000-04:00",
        "LastUpdatedTime": "2020-08-11T23:15:35.438000-04:00",
        "ImportMode": "SPICE"
    }
   

3. Get your users Arn by editing the following command, replacing AccountID with your account ID, and region with the region you are working in, then using the CLI run the command:

    aws quicksight list-users --aws-account-id (AccountID) --namespace default --region (region)
   

    

    {
            "Arn": "arn:aws:quicksight:us-east-1:<your account id>:user/default/<your user>",
            "UserName": "<your user>",
            "Email": "<your user email>",
            "Role": "ADMIN",
            "Active": true,
            "PrincipalId": "<principal id>"
    }
   

4. Create a local file create-data-transfer-dashboard.json with the text below, replace the values (Account ID) with your account ID on line 2 and line 25, (User ARN) with your user ARN on line 7, and (DataTransfer view Dataset ID) with your dataset ARN on line 25:

    {
        "AwsAccountId": "(Account ID)",
        "DashboardId": "data_transfer_cost_analysis_dashboard_enhanced",
        "Name": "DataTransfer Cost Analysis Dashboard Enhanced",
        "Permissions": [
            {
                "Principal": "(User ARN)",
                "Actions": [
                        "quicksight:DescribeDashboard",
                        "quicksight:ListDashboardVersions",
                        "quicksight:UpdateDashboardPermissions",
                        "quicksight:QueryDashboard",
                        "quicksight:UpdateDashboard",
                        "quicksight:DeleteDashboard",
                        "quicksight:DescribeDashboardPermissions",
                        "quicksight:UpdateDashboardPublishedVersion"
                ]
            }
        ],
        "SourceEntity": {
            "SourceTemplate": {
                "DataSetReferences": [
                    {
                        "DataSetPlaceholder": "data_transfer_view",
                        "DataSetArn": "arn:aws:quicksight:us-east-1:(Account ID):dataset/(DataTransfer view Dataset ID)"
   
                    }
                ],
                        "Arn": "arn:aws:quicksight:us-east-1:869004330191:template/data-transfer-aga-est-cost-analysis-template-enhanced-v1"
            }
        },
        "VersionDescription": "1"
    }
   

5. To create the dashboard from the template, edit then run the following command, replacing (region) with the region you are working in, and you should receive a 202 response:

    aws quicksight create-dashboard --cli-input-json file://create-data-transfer-dashboard.json --region (region)
   

   • Response:

6. After a few minutes the dashboard will become available in QuickSight under All dashboard, click on the Dashboard name:

7. Follow step 7 if you do not see your dashboard

Edit and run the following command:

    aws quicksight describe-dashboard --aws-account-id (Account ID) --dashboard-id data_transfer_cost_analysis_dashboard --region (region)

Correct the listed errors and run the delete-dashboard command followed by the original create-dashboard command:

    aws quicksight delete-dashboard --aws-account-id (Account ID) --dashboard-id data_transfer_cost_analysis_dashboard --region (region)

Saving and Sharing your Dashboard in QuickSight

Now that you have your dashboard created you can share your dashboard with users or customize your own version of this dashboard

• Click to navigate QuickSight steps