CUDOS Dashboard

Create Athena Views

The data source for the dashboard will be an Athena view of your existing Cost and Usage Report (CUR). The default dashboard assumes you have both Savings Plans and Reserved Instances, if not you will need to create the alternate views.

1. Login via SSO in your Cost Optimization account, go into the Athena console:

2. Modify and run the following queries to confirm if you have Savings Plans, and Reserved Instances in your usage. If no lines are returned, you have no Savings Plans or Reserved Instances. Replace (database).(tablename) and run the following:

   Savings Plans:

    select * from (database).(tablename)
    where savings_plan_savings_plan_a_r_n not like ''
    limit 10
   

   Reserved Instances:

    select * from (database).(tablename)
    where reservation_reservation_a_r_n not like ''
    limit 10
   

3. Create the account_map view by modifying the following code, and executing it in Athena:

   • View0 - account_map

4. Create the Summary view by modifying the following code, and executing it in Athena:

   • View1 - Summary View

5. Create the EC2_Running_Cost view by modifying the following code, and executing it in Athena:

   • View2 - EC2_Running_Cost

6. Create the Compute savings plan eligible spend view by modifying the following code, and executing it in Athena:

   • View3 - compute savings plan eligible spend

7. Create the s3 view by modifying the following code, and executing it in Athena:

   • View4 - s3

8. Create the RI SP Mapping view by modifying the following code, and executing it in Athena:

   • View5 - RI SP Mapping

9. Create the customer_all view by modifying the following code, and executing it in Athena:

   • View6 - customer_all

Create QuickSight Data Sets

Create Datasets

1. Go to the QuickSight service homepage inside your account. Be sure to select the correct region from the top right user menu or you will not see your expected tables

   

2. From the left hand menu, choose Datasets

   

3. Click New dataset displayed in the top right corner

   

4. Choose Athena as your Data Source

   

5. Enter a data source name of Cost_Dashboard and click Create data source

   

6. Select the database which holds the views you created (reference Athena if you’re unsure which one to select), and the summary_view table, then click Edit/Preview data

   

7. Select SPICE to change your Query mode

   

8. Click Add Data

   

9. Choose your account_map view and click Select

   

10. Click the two circles to open the Join configuration, then select Left to change your join type

    

11. Configure the join clause to linked_account_id = account_id, then click Apply

    

12. Select Save

    

13. Select the summary_view dataset

    

14. Click Schedule refresh

    

15. Click Create

    

16. Enter a daily schedule, in the appropriate time zone and click Create

    

17. Click Cancel to exit

    

18. Click x to exit

    

19. Repeat steps 3-18, creating data sets with the remaining Athena views. The data source name will be Cost_Dashboard, and select the following views as the table:

• s3_view

• ec2_running_cost

• compute_savings_plan_eligible_spend

  When this step is complete, your Datasets tab should have 4 new SPICE Datasets.

20. Select the summary_view dataset

    

21. Click Edit Data Set

    

22. Click Add Data

    

23. Choose your ri_sp_mapping view and click Select

    

24. Click the two circles to open the Join configuration, then select Left to change your join type

    

25. Click Add a new join clause twice so you have 3 join clauses to configure in total. Configure the 3 join clauses as below, then click Apply

    • ri_sp_arn = ri_sp_arn_mapping
    • payer_account_id = payer_account_id_mapping
    • billing_period = billing_period_mapping

    

26. Click Save

    

27. Click New dataset displayed in the top right corner of QuickSight

    

28. Select your existing Cost_Dashboard as your Data Source

29. Select Create dataset

30. Select the database which holds your customer_all view and select that view then click Edit/Preview data

31. Keep the Query mode as Direct query

    

32. Repeat steps 8-18, but configure this join clause in step 11: line_item_usage_account_id = account_id

    

Import Dashboard Template

We will now use the CLI to create the dashboard from the CUDOS Dashboard template.

1. Edit and Run list-users and make a note of your User ARN:

aws quicksight list-users --aws-account-id <Account_ID> --namespace default --region <Region>

2. Edit and Run list-data-sets and make a note of the Name and Arn for the 5 Datasets ARNs:

aws quicksight list-data-sets --aws-account-id <Account_ID> --region <Region>

3. Create an import.json file using the below sample

{
    "AwsAccountId": "<Account_ID>",
    "DashboardId": "cudos",
    "Name": "CUDOS",
    "Permissions": [
         {
                "Principal": "<User ARN>",
        "Actions": [
                     "quicksight:DescribeDashboard",
                     "quicksight:ListDashboardVersions",
                     "quicksight:UpdateDashboardPermissions",
                     "quicksight:QueryDashboard",
                     "quicksight:UpdateDashboard",
                     "quicksight:DeleteDashboard",
                     "quicksight:DescribeDashboardPermissions",
                     "quicksight:UpdateDashboardPublishedVersion"
            ]
        }
    ],
"DashboardPublishOptions": {
"AdHocFilteringOption": {
"AvailabilityStatus": "DISABLED"
}
},
    "SourceEntity": {
        "SourceTemplate": {
            "DataSetReferences": [
                {
                    "DataSetPlaceholder": "summary_view",
                    "DataSetArn": "arn:aws:quicksight:<Region>:<Account ID>:dataset/<DatasetID>"

                },
                                         {
                    "DataSetPlaceholder": "ec2_running_cost",
                    "DataSetArn": "arn:aws:quicksight:<Region>:<Account ID>:dataset/<DatasetID>"

                },
                                         {
                     "DataSetPlaceholder": "compute_savings_plan_eligible_spend",
                     "DataSetArn": "arn:aws:quicksight:<Region>:<Account ID>:dataset/<DatasetID>"

                 },
                                         {
                     "DataSetPlaceholder": "s3_view",
                     "DataSetArn": "arn:aws:quicksight:<Region>:<Account ID>:dataset/<DatasetID>"

                 },
                              {
                 "DataSetPlaceholder": "customer_all",
                 "DataSetArn": "arn:aws:quicksight:<Region>:<Account ID>:dataset/<DatasetID>"
             }
             ],
                     "Arn": "arn:aws:quicksight:us-east-1:223485597511:template/cudos_dashboard_v3"
         }
     },
     "VersionDescription": "1"
}

4. Update the import.json to match your details by replacing the following placeholders:

   Placeholder	Replace with
   <Account_ID>	AWS Account ID where the dashboard will be deployed
   <Region>	Region Code where the dashboard will be deployed (Example eu-west-1)
   <User ARN>	ARN of your user
   <DataSetId>	Replace with Dataset ID’s from the data sets you created in the Preparing Quicksight section NOTE: There are 5 unique Dataset IDs

5. Run the import

aws quicksight create-dashboard --cli-input-json file://import.json --region <Region> --dashboard-id cudos

6. Check the status of your deployment

aws quicksight describe-dashboard --dashboard-id cudos --region <Region> --aws-account-id <Account_ID>

If you encounter no errors, open QuickSight from the AWS Console, and navigate to Dashboards. You should now see CUDOS available. This dashboard can be shared with other users, but is otherwise ready for viewing and customizing.

If something goes wrong in the dashboard creation step, correct the issue then delete the failed deployment before re-deploying

aws quicksight delete-dashboard --dashboard-id cudos --region <Region> --aws-account-id <Account_ID>

Saving and Sharing your Dashboard in QuickSight

Now that you have your dashboard created you can share your dashboard with users or customize your own version of this dashboard

• Click to navigate QuickSight steps

• Navigate to the CUDOS section of the Cloud Intelligence Dashboards automation repo

If you are tracking our Changelog , you already know that we continue improving Cloud Intelligence Dashboards.

To pull the latest version of the dashboard from the public template please use the following steps.

1. Create an update.json file by removing permissions section from the import.json file. Sample for CUDOS Dashboard update.json file below:

{
    "AwsAccountId": "<Account_ID>",
    "DashboardId": "cudos",
    "Name": "CUDOS",
    "DashboardPublishOptions": {
      "AdHocFilteringOption": {
        "AvailabilityStatus": "DISABLED"
      }
    },
    "SourceEntity": {
      "SourceTemplate": {
        "DataSetReferences": [
          {
            "DataSetPlaceholder": "summary_view",
            "DataSetArn": "arn:aws:quicksight:<region>:<Account_ID>:dataset/<DatasetID>"
          },
          {
            "DataSetPlaceholder": "ec2_running_cost",
            "DataSetArn": "arn:aws:quicksight:<region>:<Account_ID>:dataset/<DatasetID>"
          },
          {
            "DataSetPlaceholder": "compute_savings_plan_eligible_spend",
            "DataSetArn": "arn:aws:quicksight:<region>:<Account_ID>:dataset/<DatasetID>"
          },
          {
            "DataSetPlaceholder": "s3_view",
            "DataSetArn": "arn:aws:quicksight:<region>:<Account_ID>:dataset/<DatasetID>"
          },
          {
            "DataSetPlaceholder": "customer_all",
            "DataSetArn": "arn:aws:quicksight:<region>:<Account_ID>:dataset/<DatasetID>"
          }
        ],
        "Arn": "arn:aws:quicksight:us-east-1:223485597511:template/cudos_dashboard_v3"
          }
      }
}

2. If needed update the update.json to match your details by replacing the following placeholders:

   Placeholder	Replace with
   <Account_ID>	AWS Account ID where the dashboard will be deployed
   <Region>	Region Code where the dashboard will be deployed (Example eu-west-1)
   <DatasetID>	Replace with Dataset ID’s from the datasets you created in the Preparing Quicksight section NOTE: There are 5 unique Dataset IDs

3. Pull the latest published version of the dashboard template. Example for CUDOS Dashboard below:

aws quicksight update-dashboard --cli-input-json file://update.json --region <region>

4. Query the version number of the published dashboard. Example for CUDOS Dashboard below:

aws quicksight list-dashboard-versions --region <region> --aws-account-id <Account_ID> --dashboard-id cudos --query 'sort_by(DashboardVersionSummaryList, &VersionNumber)[-1].VersionNumber'

5. Apply the latest pulled changes to the deployed dashboard with this CLI command. Example for CUDOS Dashboard below:

aws quicksight update-dashboard-published-version --region <region> --aws-account-id <Account_ID> --dashboard-id cudos --version-number <version>