Make the most of your investment in BigQuery using the BigQuery Performance Monitoring block, to identify several opportunities to optimize performance and slot consumption:

BigQuery offers a set of native metadata tables called BigQuery Information Schema, which provide comprehensive data on consumption and performance across the entire organization. Make the most of your investment in BigQuery using the BigQuery Performance Monitoring block, to identify several opportunities to optimize performance and slot consumption:

  • Investigate windows and patterns of high and low consumption against capacity to optimize slot capacity distribution
  • Identify troublesome queries and users driving concurrency and average query time, across all projects in the organization
  • Monitor overall health and performance of the BigQuery environment, providing a central hub for Database administration and auditing
  • Break down queries by their individual execution patterns and job stages to reconfigure query patterns and table partitions / clusters to optimize the investment in BigQuery

Required Permissions:

The Block is built off of the _JOBS_BY_ORGANIZATION_ and _JOBS_TIMELINE_BY_ORGANIZATION_ tables, to provide a complete picture of usage across all projects. This block requires a Service Account with the following BigQuery permissions: _bigquery.jobs.listAll_ for the organization and is available to the organization _bigquery.resourceAdmin_, Organization Owner and Organization Admin roles. Note that _JOBS_BY_ORGANIZATION_ is only available to users with defined Google Cloud organizations. More information on permissions and access control in BigQuery can be found here. Due to potential query costs, this Block is currently intended only for customers with Committed Slots Flat-Rate customers, not On-Demand customers.