sort GCP billing data by metadata tags

Question

I'm a little confused in GCP with tags, labels and metadata and I do not find how to sort my billing informations by the metadata tags i set for every objects in the storage. I have added a metadata tagging process which gives the id of the account that uploads a file through signed url headers or through blobs uploads. Then I launch requests on the billing with big query. ...but I do not see my tags in the "labels" field of the exports How can I enable metadata tags sorting on billing exports ?

Thank you for your help

Answer 1

Metadata identifies properties of the object, as well as specifies how the object should be handled when it's accessed. Metadata exists as key:value pairs. Metadata has fixed-key metadata, also Custom metadata, that is to say you can add any key:value value in your metadata.

If a group of GCP resources has the same key:value in its custom mateadata, who can take this key:value as the Bucket labels are key:value that allow you to group your buckets along with other Google Cloud resources such as virtual machine instances and persistent disks.

Tagging actually is like a condition, for example, I want to query those resources which have a specific key:value, then the service will look for those resources which have a label the same as key value.

May the explanation is still not easy to understand, let me use sql query as an example.

SELECT GCP.Resources.Cost FROM GCP.Resources WHERE GCP.Resources.Lable = Tag GROUP BY GCP.Resources.Metadata

Answer 2

Tags data is available in both the Standard usage cost export and the Detailed usage cost export

SELECT
  invoice.month AS invoice_month,
  tag.value AS cost_center,
  ROUND((SUM(CAST(cost AS NUMERIC))
    + SUM(IFNULL((SELECT SUM (CAST(c.amount AS NUMERIC))
                  FROM UNNEST(credits) AS c), 0))), 2)
    AS net_cost
FROM `ivory-vim-309221.billing_export_dataset.gcp_billing_export_resource_v1_018ADD_3CEBBB_A4DF22`, UNNEST(tags) AS tag
WHERE tag.key = "cost_center" AND tag.namespace = "821092389413"
GROUP BY invoice.month, tag.value
ORDER BY invoice.month, tag.value;

https://cloud.google.com/billing/docs/how-to/export-data-bigquery-tables/standard-usage#tags

Answer 3

GCP billing doesn't break down Bucket costs by object.

It simply tells you how much the whole bucket cost you.

If you want to calculate what portion of your Bucket bill can be attributed to an object you will need to know when the object was uploaded and how big it was, and then do math to calculate the portion of the cost it's responsible for.

You would need to turn on logging on the buck to get that data.