Host your data on the provider of your choice

For some providers, it is possible to store your cost data on a dedicated S3 bucket and database, hosted on the cloud provider of your choice.

This page explains step by step how to set it up.

For new accounts, after your initial login you are asked to provide this information if you want. For existing accounts, or for users who decided not to do it after the initial login, you can configure this at any point in time.

From the Holori homepage, navigate to the configuration page by clicking on your username at the bottom left corner. Then click on Settings and go to the S3 Bucket and Database tab.

Select your cloud provider below. Each tab covers both the S3 bucket and the database setup for that provider.

info

Whichever provider you choose, make sure the following IP addresses are whitelisted on your database's firewall or security group so Holori's servers can connect: 52.47.71.189/32, 52.47.172.58/32, and 35.181.254.208/32.

AWS

S3 bucket

There are two ways to create the S3 bucket on AWS. You'll see two tabs corresponding to both options in the App.

Using CloudFormation

Open the URL in the App to navigate to CloudFormation with automatically filled parameters.

Once the S3 bucket is created, copy and paste the following information into Holori: the region name, bucket name, access key ID, and secret access key.

Once done, click on Continue.

Manually using the AWS Console

1. Create the bucket

1. Choose the region you want to create the bucket in. This can be selected in the top right corner of your screen.
2. Copy the region name and paste it into Holori.
3. Navigate to the S3 service.
4. Click on Create bucket.
5. Give your bucket a name, then copy and paste it into Holori.
6. Leave the other settings at their default values and click on Create.

Your bucket is now created.

2. Create the access keys

1. Navigate to the IAM service.
2. Select Users in the left sidebar.
3. Click on Create user.
4. Give it a specific name for this use case, for example Holori S3 archive.
5. Click on Next.
6. Select Attach policies directly, then click on Create policy.
7. In the new tab, click on JSON and paste the following permission:

{
  "Version": "2012-10-17",
  "Statement": [
    {
      "Sid": "VisualEditor0",
      "Effect": "Allow",
      "Action": [
        "s3:PutObject",
        "s3:GetObject",
        "s3:ListBucket",
        "s3:DeleteObject"
      ],
      "Resource": [
        "arn:aws:s3:::<your-bucket-name>",
        "arn:aws:s3:::<your-bucket-name>/*"
      ]
    }
  ]
}

8. Click on Next, give the policy a name, then click on Create policy.
9. Make sure the policy you just created is selected for the user.
10. Click on Next, verify that everything is correct, then click on Create user.
11. Open the newly created user's details and click on Identification and security information.
12. Scroll down to Access keys and click on Create access key.
13. Select one of the options, confirm it, then click on Next.
14. Give it a name and click on Next.
15. Click on Download .csv file. You will not be able to access the secret key again after leaving this page.
16. Open the downloaded file and copy the Access key ID and Secret access key into Holori.

You've now created your access keys. You can close the CSV file and the key creation page.

Database

There are two ways to create the database on AWS. You'll see two tabs corresponding to both options in the App.

Using CloudFormation

Open the URL in the App to navigate to CloudFormation with automatically filled parameters.

Once the database is created, copy and paste the following information into Holori: the host, username, and password.

Once done, click on Continue.

Manually using the AWS Console

First, open and connect to your AWS web console.

1. Create the database

1. Choose the region you want to create the database in. This can be selected in the top right corner of your screen.
2. Navigate to the RDS service.
3. Click on Create database in the Create with a complete configuration card.
4. Choose PostgreSQL.
5. Choose Standard create.
6. Select the Free tier template.
7. Choose Single-AZ deployment.
8. Select a value for Engine version of 17 or higher.
9. Give your database instance a name in DB instance identifier.
10. Enter a Master username and copy and paste it into Holori.
11. Enter a strong Master password and copy and paste it into Holori.
12. Select a public VPC and subnet group, creating them if needed.
13. Select Public access.
14. Select a security group that allows Holori's servers to access your database.
15. CloudWatch settings are optional, you can disable them if you don't need them.
16. Click on Create database. Creation can take a few minutes.

Your database is now created.

2. Get the database endpoint

1. Navigate to the database you just created.
2. Open the Connectivity and security tab.
3. Under Endpoints, find the Additional configurations section.
4. Copy the Endpoint value and paste it into Holori.
5. Click on Continue.

GCP

S3 bucket

First, open and connect to your GCP web console.

1. Create the service account

1. Navigate to the IAM and admin panel.
2. Click on Service accounts in the left sidebar.
3. Click on Create service account.
4. Give it a name.
5. Skip the permissions and role definition and click on Create and continue, then Done.
6. Note the service account email somewhere, you will need it in step 3.

2. Create the bucket

1. Choose the project you want to create the bucket in. This can be selected in the top left corner of your screen.
2. Navigate to the Storage service.
3. Click on Buckets in the left sidebar.
4. Give your bucket a name, then copy and paste it into Holori.
5. Choose a region in which the bucket will be created.
6. Leave the other settings at their default values and click on Create.

Your bucket is now being created.

3. Set the bucket permissions

1. Click on your newly created bucket.
2. Click on the Permissions tab.
3. Click on Grant access.
4. Paste the service account email in the New principals field.
5. Select the Storage Object Admin role.
6. Click on Save.

4. Create the access key

1. Navigate to the Storage service.
2. Click on Settings in the left sidebar.
3. Click on the Interoperability tab.
4. Copy the Endpoint URL and paste it into Holori.
5. Make sure the project in which you created the bucket is selected as the Default project.
6. Click on Create a key for a service account.
7. Find and select the service account you created in step 1.
8. Click on Create key.
9. Copy the Access key and Secret and paste them into Holori.

Database

First, open and connect to your GCP web console.

1. Create the database

1. Navigate to the Cloud SQL service.
2. Click on Instances in the left sidebar.
3. Click on the PostgreSQL tab.
4. Click on Create a Sandbox instance.
5. Select the Enterprise edition.
6. Select Sandbox for Edition preset.
7. Select a PostgreSQL version of 17 or higher.
8. Give your instance a name in Instance ID.
9. Generate a password and copy and paste it into Holori.
10. Choose the region in which the database will be created.
11. Keep Single zone selected.
12. Click on Create instance.

Your database is now being created.

2. Get the database information

1. A page with information about your newly created database should open automatically.
2. Refresh the page once the deployment is complete.
3. Copy the Public IP address value and paste it into Holori.
4. Click on Continue.

Azure

S3 bucket

caution

Azure is currently not supported for S3 bucket storage, due to compatibility issues on their end. Please use another provider to host your S3 bucket.

Database

Using Bicep

Step 1: Get your subscription information

1. Open and connect to your Azure console.
2. Navigate to the Subscriptions service.
3. Find the subscription you want to create the database in.
4. Copy its Subscription ID and paste it into Holori.

Step 2: Deploy the database

1. Click on Cloud Shell in the top right corner of the screen.
2. Download the file linked in the Holori App.
3. Click on Manage files, then Upload, to upload the file you just downloaded.
4. Run this command, replacing <subscription-id> with your subscription ID:

az group create --name holoriDatabaseResourceGroup --location eastus --subscription <subscription-id> && \
az deployment group create --mode Complete --resource-group holoriDatabaseResourceGroup --subscription <subscription-id> --template-file ./postgresql.bicep --parameters postgresql_password="c67a60f6-ed35-42a3-b21f-010226877b19" && \
az deployment group show -g holoriDatabaseResourceGroup --subscription <subscription-id> -n postgresql --query properties.outputs

5. Copy the postgresqlServerFQDN value and paste it into Holori.
6. Click on Continue.

Manually using the Azure Console

First, open and connect to your Azure web console.

1. Create the database

1. Navigate to the Azure Database for PostgreSQL flexible servers service.
2. Click on Create.
3. Select the subscription and resource group in which you want to create the database.
4. Give it a unique Server name.
5. Select the region in which you want to deploy the database.
6. Select a PostgreSQL version of 17 or higher.
7. Choose Dev/Test for Workload type.
8. Configure the server as you wish, the default is fine as a starting point.
9. Zonal resiliency is not necessary, you can disable it.
10. Choose PostgreSQL authentication only for Authentication method.
11. Set an Administrator login value and copy and paste it into Holori.
12. Generate a strong Administrator password and copy and paste it into Holori.
13. Click on Next.
14. Select Public access for Connectivity method and enable it.
15. Under Firewall rules, click on + Add 0.0.0.0 - 255.255.255.255.
16. Confirm and click on Next.
17. Leave the default security settings and click on Next.
18. Set tags if you want, then click on Next.
19. Review the information and click on Create.

Your database is now being created.

2. Get the database endpoint

1. Open the database you just created.
2. Copy the Server FQDN value and paste it into Holori.
3. Click on Continue.

OCI

S3 bucket

First, open and connect to your OCI web console.

1. Get your tenancy details

1. Click on your profile in the top right corner of the screen.
2. Click on Tenancy to open your tenancy details page.
3. Copy the Object storage namespace value and paste it into Holori.
4. Click on Region management in the left sidebar.
5. Copy the Region Identifier of your home region and paste it into Holori.

2. Create the bucket

1. Navigate to the Storage service.
2. Click on Object Storage & Archive Storage, then Buckets, in the left sidebar.
3. Click on Create Bucket.
4. Give your bucket a name, then copy and paste it into Holori.
5. Make sure Bucket Scope is set to Namespace.
6. Leave the other settings at their default values and click on Create.

Your bucket is now being created.

3. Create the user

1. Navigate to Identity & Security, then Domains, under the Identity section.
2. Click on your current domain.
3. Click on the User management tab.
4. Click on Create user, under the Users section.
5. Give the user a name, for example Holori archive bucket.
6. Enter a valid email address. Keep Use the email address as the username enabled.
7. Do not attach any group to this user, this is done in a later step.
8. Click on Create.

4. Create the access key

1. Open the user you just created.
2. Click on the Customer secret keys tab.
3. Click on Generate secret key.
4. Give it a name and click on Create.
5. Copy the Generated Key value and paste it into Holori as the secret key.
6. Click on Close.
7. Click on the three dots to the right of the generated key line.
8. Click on Copy Access key and paste it into Holori.

5. Create the group

1. Navigate back to Identity & Security, then Domains, under the Identity section.
2. Click on your current domain.
3. Click on the User management tab.
4. Click on Create group, under the Groups section.
5. Give it exactly this name: holori-archive-bucket.
6. Select the user you created in step 3.
7. Click on Create.

6. Create the access policy

1. Navigate to Identity & Security, then Policies, under the Identity section.
2. Click on Create Policy.
3. Give it exactly this name: holori-archive-bucket-access.
4. Click on Show manual editor.
5. Fill the text area with this policy, replacing <your-bucket-name> with your actual bucket name:

Allow group holori-archive-bucket to manage objects in tenancy where all {target.bucket.name='<your-bucket-name>'}

6. Click on Save.

Database

First, open and connect to your OCI web console.

You can create a PostgreSQL instance using the DB Systems service. Keep in mind this option can be quite expensive, and you will need to define a working network configuration yourself to allow Holori's servers to access this instance.

Alternatively, you can manage your own instance: create a small virtual machine and install PostgreSQL on it. The virtual machine must be on a public network with a public IP address. Make sure to expose the PostgreSQL service on all network interfaces.

OVHcloud

S3 bucket

First, open and connect to your OVHcloud web console.

1. Create the bucket

1. Click on the Public Cloud tab.
2. Click on Object storage, under the Storage category, in the left sidebar.
3. Click on Create an object container.
4. Give your bucket a name, then copy and paste it into Holori.
5. Select S3 compatible API.
6. Choose the region you want to create the bucket in.
7. In the User field, click on Create a new user.
8. Give this new user a name, for example holori-archive-bucket.
9. Select this newly created user in the dropdown.
10. Click on See credentials and copy the Access key and Secret key into Holori.
11. Leave the other settings at their default values and click on Create an object container.

Your object storage is now being created.

2. Get the bucket information

1. Open your newly created object storage.
2. Click on General information.
3. Copy the Endpoint value and paste it into Holori.

Database

1. Create the database

1. Navigate to Databases, under the Databases & Analytics section, in the left sidebar.
2. Click on Create a managed database.
3. Give it a unique name.
4. Select PostgreSQL for Engine.
5. Select a version of 17 or higher.
6. Choose the region in which your database will be created.
7. Select the Essential plan, or Discovery depending on your region.
8. Choose the smallest instance and storage capacity as a good starting point.
9. Under Options, select Public network and add the following IP addresses: 52.47.71.189/32, 52.47.172.58/32, and 35.181.254.208/32.
10. Click on Order in the right sidebar.

Your database is now being created.

2. Get the database information

1. Once created, the database details page should be displayed.
2. Refresh the page once the deployment is complete.
3. Click on the Dashboard tab.
4. Copy the Host and Port values and paste them into Holori.
5. Download or copy the SSL certificate and paste it into Holori.
6. Click on the Users tab.
7. Copy the Username value and paste it into Holori.
8. On the right, click on the three dots action menu and choose Reset password.
9. Click on Confirm, then copy the new password into Holori.
10. Click on Continue.