Documentation

InfluxDB OSS metrics

Get metrics about the workload performance of an InfluxDB OSS instance.

InfluxDB OSS exposes a /metrics endpoint that returns performance, resource, and usage metrics formatted in the Prometheus plain-text exposition format.

GET http://localhost:8086/metrics

Metrics contain a name, an optional set of key-value pairs, and a value.

The following descriptors precede each metric:

Example

# HELP go_info Information about the Go environment.
# TYPE go_info gauge
go_info{version="go1.17"} 1
# HELP go_memstats_alloc_bytes Number of bytes allocated and still in use.
# TYPE go_memstats_alloc_bytes gauge
go_memstats_alloc_bytes 2.27988488e+08
# HELP go_memstats_alloc_bytes_total Total number of bytes allocated, even if freed.
# TYPE go_memstats_alloc_bytes_total counter
go_memstats_alloc_bytes_total 9.68016566648e+11

The InfluxDB /metrics endpoint returns metrics associated with the following categories:

Boltdb statistics

Reads total

Total number of boltdb reads.

Example

# HELP boltdb_reads_total Total number of boltdb reads
# TYPE boltdb_reads_total counter
boltdb_reads_total 75129

Writes total

Total number of boltdb writes.

Example

# HELP boltdb_writes_total Total number of boltdb writes
# TYPE boltdb_writes_total counter
boltdb_writes_total 201591

Go runtime statistics

For more detail about Go runtime statistics, see the following:

GC (garbage collection) duration seconds

Summary of the pause duration of garbage collection cycles.

Example

# HELP go_gc_duration_seconds A summary of the pause duration of garbage collection cycles.
# TYPE go_gc_duration_seconds summary
go_gc_duration_seconds{quantile="0"} 5.1467e-05
--

Goroutines

Number of goroutines that currently exist.

Example

# HELP go_goroutines Number of goroutines that currently exist.
# TYPE go_goroutines gauge
go_goroutines 1566

Info

Information about the Go environment.

Example

# HELP go_info Information about the Go environment.
# TYPE go_info gauge
go_info{version="go1.17"} 1

Memory allocated bytes

Number of bytes allocated and still in use.

Example

# HELP go_memstats_alloc_bytes Number of bytes allocated and still in use.
# TYPE go_memstats_alloc_bytes gauge
go_memstats_alloc_bytes 2.27988488e+08

Memory allocated bytes total

Total number of bytes allocated, even if freed.

Example

# HELP go_memstats_alloc_bytes_total Total number of bytes allocated, even if freed.
# TYPE go_memstats_alloc_bytes_total counter
go_memstats_alloc_bytes_total 9.68016566648e+11

Memory bucket hash system bytes

Number of bytes used by the profiling bucket hash table.

Example

# HELP go_memstats_buck_hash_sys_bytes Number of bytes used by the profiling bucket hash table.
# TYPE go_memstats_buck_hash_sys_bytes gauge
go_memstats_buck_hash_sys_bytes 1.0067613e+07

Memory frees total

Total number of frees.

Example

# HELP go_memstats_frees_total Total number of frees.
# TYPE go_memstats_frees_total counter
go_memstats_frees_total 1.3774541795e+10

Memory GC (garbage collection) CPU fraction

Fraction of this program’s available CPU time used by the GC since the program started.

Example

# HELP go_memstats_gc_cpu_fraction The fraction of this program's available CPU time used by the GC since the program started.
# TYPE go_memstats_gc_cpu_fraction gauge
go_memstats_gc_cpu_fraction 0.011634918451016558

Memory GC (garbage collection) system bytes

Number of bytes used for garbage collection system metadata.

Example

# HELP go_memstats_gc_sys_bytes Number of bytes used for garbage collection system metadata.
# TYPE go_memstats_gc_sys_bytes gauge
go_memstats_gc_sys_bytes 4.63048016e+08

Memory heap allocated bytes

Number of heap bytes allocated and still in use.

Example

# HELP go_memstats_heap_alloc_bytes Number of heap bytes allocated and still in use.
# TYPE go_memstats_heap_alloc_bytes gauge
go_memstats_heap_alloc_bytes 2.27988488e+08

Memory heap idle bytes

Number of heap bytes waiting to be used.

Example

# HELP go_memstats_heap_idle_bytes Number of heap bytes waiting to be used.
# TYPE go_memstats_heap_idle_bytes gauge
go_memstats_heap_idle_bytes 1.0918273024e+10

Memory heap in use bytes

Number of heap bytes that are in use.

Example

# HELP go_memstats_heap_inuse_bytes Number of heap bytes that are in use.
# TYPE go_memstats_heap_inuse_bytes gauge
go_memstats_heap_inuse_bytes 3.5975168e+08

Memory heap objects

Number of allocated objects. Allocated heap objects include all reachable objects, as well as unreachable objects that the garbage collector has not yet freed.

Example

# HELP go_memstats_heap_objects Number of allocated objects.
# TYPE go_memstats_heap_objects gauge
go_memstats_heap_objects 2.404017e+06

Memory heap released bytes

Number of heap bytes released to the OS.

Example

# HELP go_memstats_heap_released_bytes Number of heap bytes released to OS.
# TYPE go_memstats_heap_released_bytes gauge
go_memstats_heap_released_bytes 2.095038464e+09

Memory heap system bytes

Number of heap bytes obtained from the system.

Example

# HELP go_memstats_heap_sys_bytes Number of heap bytes obtained from system.
# TYPE go_memstats_heap_sys_bytes gauge
go_memstats_heap_sys_bytes 1.1278024704e+10

Memory last GC (garbage collection) time seconds

Number of seconds since 1970 of the last garbage collection.

Example

# HELP go_memstats_last_gc_time_seconds Number of seconds since 1970 of last garbage collection.
# TYPE go_memstats_last_gc_time_seconds gauge
go_memstats_last_gc_time_seconds 1.64217120199452e+09

Memory lookups total

Total number of pointer lookups.

Example

# HELP go_memstats_lookups_total Total number of pointer lookups.
# TYPE go_memstats_lookups_total counter
go_memstats_lookups_total 0

Memory allocations total

Cumulative count of heap objects allocated.

Example

# HELP go_memstats_mallocs_total Total number of mallocs.
# TYPE go_memstats_mallocs_total counter
go_memstats_mallocs_total 1.3776945812e+10

Memory mcache in use bytes

Number of bytes in use by mcache structures.

Example

# HELP go_memstats_mcache_inuse_bytes Number of bytes in use by mcache structures.
# TYPE go_memstats_mcache_inuse_bytes gauge
go_memstats_mcache_inuse_bytes 9600

Memory mcache system bytes

Number of bytes used for mcache structures obtained from system.

Example

# HELP go_memstats_mcache_sys_bytes Number of bytes used for mcache structures obtained from system.
# TYPE go_memstats_mcache_sys_bytes gauge
go_memstats_mcache_sys_bytes 16384

Memory mspan in use bytes

Number of bytes of allocated mspan structures.

Example

# HELP go_memstats_mspan_inuse_bytes Number of bytes in use by mspan structures.
# TYPE go_memstats_mspan_inuse_bytes gauge
go_memstats_mspan_inuse_bytes 4.199e+06

Memory mspan system bytes

Bytes of memory obtained from the OS for mspan structures.

Example

# HELP go_memstats_mspan_sys_bytes Number of bytes used for mspan structures obtained from system.
# TYPE go_memstats_mspan_sys_bytes gauge
go_memstats_mspan_sys_bytes 1.65609472e+08

Memory next GC (garbage collection) bytes

Number of heap bytes when next garbage collection will take place.

Example

# HELP go_memstats_next_gc_bytes Number of heap bytes when next garbage collection will take place.
# TYPE go_memstats_next_gc_bytes gauge
go_memstats_next_gc_bytes 4.45628016e+08

Memory other system bytes

Number of bytes used for other system allocations.

Example

# HELP go_memstats_other_sys_bytes Number of bytes used for other system allocations.
# TYPE go_memstats_other_sys_bytes gauge
go_memstats_other_sys_bytes 8.1917722e+07

Memory stack in use bytes

Number of bytes in use by the stack allocator.

Example

# HELP go_memstats_stack_inuse_bytes Number of bytes in use by the stack allocator.
# TYPE go_memstats_stack_inuse_bytes gauge
go_memstats_stack_inuse_bytes 8.84736e+06

Memory stack system bytes

Number of bytes obtained from system for stack allocator.

Example

# HELP go_memstats_stack_sys_bytes Number of bytes obtained from system for stack allocator.
# TYPE go_memstats_stack_sys_bytes gauge
go_memstats_stack_sys_bytes 8.84736e+06

Memory system bytes

Number of bytes obtained from system.

Example

# HELP go_memstats_sys_bytes Number of bytes obtained from system.
# TYPE go_memstats_sys_bytes gauge
go_memstats_sys_bytes 1.2007531271e+10

Threads

Number of OS threads created.

Example

# HELP go_threads Number of OS threads created.
# TYPE go_threads gauge
go_threads 27

HTTP API statistics

API request duration seconds

How long InfluxDB took to respond to the HTTP request.

Example

# HELP http_api_request_duration_seconds Time taken to respond to HTTP request
# TYPE http_api_request_duration_seconds histogram
http_api_request_duration_seconds_bucket{handler="platform",method="DELETE",path="/api/v2/authorizations/:id",response_code="204",status="2XX",user_agent="Chrome",le="0.005"} 0
--

API requests total

Number of HTTP requests received.

Example

# HELP http_api_requests_total Number of http requests received
# TYPE http_api_requests_total counter
http_api_requests_total{handler="platform",method="DELETE",path="/api/v2/authorizations/:id",response_code="204",status="2XX",user_agent="Chrome"} 1
--

Query request bytes

Count of bytes received.

Example

# HELP http_query_request_bytes Count of bytes received
# TYPE http_query_request_bytes counter
http_query_request_bytes{endpoint="/api/v2/query",org_id="48c88459ee424a04",status="200"} 727

Query request count

Total number of query requests.

Example

# HELP http_query_request_count Total number of query requests
# TYPE http_query_request_count counter
http_query_request_count{endpoint="/api/v2/query",org_id="48c88459ee424a04",status="200"} 2

Query response bytes

Count of bytes returned by the query endpoint.

Example

# HELP http_query_response_bytes Count of bytes returned
# TYPE http_query_response_bytes counter
http_query_response_bytes{endpoint="/api/v2/query",org_id="48c88459ee424a04",status="200"} 103

InfluxDB object and query statistics

Buckets total

Total number of buckets on the server.

Example

# HELP influxdb_buckets_total Number of total buckets on the server
# TYPE influxdb_buckets_total counter
influxdb_buckets_total 9

Dashboards total

Total number of dashboards on the server.

Example

# HELP influxdb_dashboards_total Number of total dashboards on the server
# TYPE influxdb_dashboards_total counter
influxdb_dashboards_total 2

Info

Information about the InfluxDB environment.

Example

# HELP influxdb_info Information about the influxdb environment.
# TYPE influxdb_info gauge
influxdb_info{arch="amd64",build_date="2021-12-28T22:12:40Z",commit="657e1839de",cpus="8",os="darwin",version="v2.1.1"} 1

Organizations total

Total number of organizations on the server.

Example

# HELP influxdb_organizations_total Number of total organizations on the server
# TYPE influxdb_organizations_total counter
influxdb_organizations_total 2

Scrapers total

Total number of scrapers on the server.

Example

# HELP influxdb_scrapers_total Number of total scrapers on the server
# TYPE influxdb_scrapers_total counter
influxdb_scrapers_total 0

Telegrafs total

Total number of Telegraf configurations on the server.

Example

# HELP influxdb_telegrafs_total Number of total telegraf configurations on the server
# TYPE influxdb_telegrafs_total counter
influxdb_telegrafs_total 0

Token services total

Total number of API tokens on the server.

Example

# HELP influxdb_tokens_total Number of total tokens on the server
# TYPE influxdb_tokens_total counter
influxdb_tokens_total 23

Uptime seconds

InfluxDB process uptime in seconds.

Example

# HELP influxdb_uptime_seconds influxdb process uptime in seconds
# TYPE influxdb_uptime_seconds gauge
influxdb_uptime_seconds{id="077238f9ca108000"} 343354.914499305

Users total

Total number of users on the server.

Example

# HELP influxdb_users_total Number of total users on the server
# TYPE influxdb_users_total counter
influxdb_users_total 84

QC (query controller) statistics

All active

Number of queries in all states.

Example

# HELP qc_all_active Number of queries in all states
# TYPE qc_all_active gauge
qc_all_active{org="48c88459ee424a04"} 0
--

All duration seconds

Total time spent in all query states.

Example

# HELP qc_all_duration_seconds Histogram of total times spent in all query states
# TYPE qc_all_duration_seconds histogram
qc_all_duration_seconds_bucket{org="48c88459ee424a04",le="0.001"} 0
--

Compiling active

Number of queries actively compiling.

Example

# HELP qc_compiling_active Number of queries actively compiling
# TYPE qc_compiling_active gauge
qc_compiling_active{compiler_type="ast",org="ed32b47572a0137b"} 0
--

Compiling duration seconds

Histogram of times spent compiling queries.

Example

# HELP qc_compiling_duration_seconds Histogram of times spent compiling queries
# TYPE qc_compiling_duration_seconds histogram
qc_compiling_duration_seconds_bucket{compiler_type="ast",org="ed32b47572a0137b",le="0.001"} 999
--

Executing active

Number of queries actively executing.

Example

# HELP qc_executing_active Number of queries actively executing
# TYPE qc_executing_active gauge
qc_executing_active{org="48c88459ee424a04"} 0
--

Executing duration seconds

Histogram of times spent executing queries.

Example

# HELP qc_executing_duration_seconds Histogram of times spent executing queries
# TYPE qc_executing_duration_seconds histogram
qc_executing_duration_seconds_bucket{org="48c88459ee424a04",le="0.001"} 0
--

Memory unused bytes

Free memory as seen by the internal memory manager.

Example

# HELP qc_memory_unused_bytes The free memory as seen by the internal memory manager
# TYPE qc_memory_unused_bytes gauge
qc_memory_unused_bytes{org="48c88459ee424a04"} 0
--

Queueing active

Number of queries actively queueing.

Example

# HELP qc_queueing_active Number of queries actively queueing
# TYPE qc_queueing_active gauge
qc_queueing_active{org="48c88459ee424a04"} 0
--

Queueing duration seconds

Histogram of times spent queueing queries.

Example

# HELP qc_queueing_duration_seconds Histogram of times spent queueing queries
# TYPE qc_queueing_duration_seconds histogram
qc_queueing_duration_seconds_bucket{org="48c88459ee424a04",le="0.001"} 2
--

Requests total

Count of the query requests.

Example

# HELP qc_requests_total Count of the query requests
# TYPE qc_requests_total counter
qc_requests_total{org="48c88459ee424a04",result="success"} 2
--

Read request duration

Histogram of times spent in read requests.

Example

# HELP query_influxdb_source_read_request_duration_seconds Histogram of times spent in read requests
# TYPE query_influxdb_source_read_request_duration_seconds histogram
query_influxdb_source_read_request_duration_seconds_bucket{op="readTagKeys",org="48c88459ee424a04",le="0.001"} 0
--

InfluxDB service statistics

Bucket service new call total

Number of calls to the bucket creation service.

Example

# HELP service_bucket_new_call_total Number of calls
# TYPE service_bucket_new_call_total counter
service_bucket_new_call_total{method="find_bucket"} 6177
--

Bucket service new duration

Duration of calls to the bucket creation service.

Example

# HELP service_bucket_new_duration Duration of calls
# TYPE service_bucket_new_duration histogram
service_bucket_new_duration_bucket{method="find_bucket",le="0.005"} 5876
--

Bucket service new error total

Number of errors encountered by the bucket creation service.

Example

# HELP service_bucket_new_error_total Number of errors encountered
# TYPE service_bucket_new_error_total counter
service_bucket_new_error_total{code="not found",method="find_bucket_by_id"} 76

Onboard service new call total

Number of calls to the onboarding service.

Example

# HELP service_onboard_new_call_total Number of calls
# TYPE service_onboard_new_call_total counter
service_onboard_new_call_total{method="is_onboarding"} 11

Onboard service new duration

Duration of calls to the onboarding service.

Example

# HELP service_onboard_new_duration Duration of calls
# TYPE service_onboard_new_duration histogram
service_onboard_new_duration_bucket{method="is_onboarding",le="0.005"} 11
--

Organization service call total

Number of calls to the organization service.

Example

# HELP service_org_call_total Number of calls
# TYPE service_org_call_total counter
service_org_call_total{method="find_labels_for_resource"} 10

Organization service duration

Duration of calls to the organization service.

Example

# HELP service_org_duration Duration of calls
# TYPE service_org_duration histogram
service_org_duration_bucket{method="find_labels_for_resource",le="0.005"} 10
--

Organization service new call total

Number of calls to the organization creation service.

Example

# HELP service_org_new_call_total Number of calls
# TYPE service_org_new_call_total counter
service_org_new_call_total{method="find_org"} 1572
--

Organization service new duration

Duration of calls to the organization creation service.

Example

# HELP service_org_new_duration Duration of calls
# TYPE service_org_new_duration histogram
service_org_new_duration_bucket{method="find_org",le="0.005"} 1475
--

Organization service new error total

Number of errors encountered by the organization creation service.

Example

# HELP service_org_new_error_total Number of errors encountered
# TYPE service_org_new_error_total counter
service_org_new_error_total{code="not found",method="find_orgs"} 1

Password service new call total

Number of calls to the password creation service.

Example

# HELP service_password_new_call_total Number of calls
# TYPE service_password_new_call_total counter
service_password_new_call_total{method="compare_password"} 4

Password service new duration

Duration of calls to the password creation service.

Example

# HELP service_password_new_duration Duration of calls
# TYPE service_password_new_duration histogram
service_password_new_duration_bucket{method="compare_password",le="0.005"} 0
--

Password service new error total

Number of errors encountered by the password creation service.

Example

# HELP service_password_new_error_total Number of errors encountered
# TYPE service_password_new_error_total counter
service_password_new_error_total{code="forbidden",method="compare_password"} 1

Pkger service call total

Number of calls to the pkger service.

Example

# HELP service_pkger_call_total Number of calls
# TYPE service_pkger_call_total counter
service_pkger_call_total{method="export"} 3

Pkger service duration

Duration of calls to the pkger service.

Example

# HELP service_pkger_duration Duration of calls
# TYPE service_pkger_duration histogram
service_pkger_duration_bucket{method="export",le="0.005"} 0
--

Pkger service template export

Metrics for exported resources.

Example

# HELP service_pkger_template_export Metrics for resources being exported
# TYPE service_pkger_template_export counter
service_pkger_template_export{buckets="0",by_stack="false",checks="0",dashboards="0",endpoints="0",label_mappings="0",labels="0",method="export",num_org_ids="1",rules="0",tasks="0",telegraf_configs="0",variables="0"} 3

Session service call total

Number of calls to the session service.

Example

# HELP service_session_call_total Number of calls
# TYPE service_session_call_total counter
service_session_call_total{method="create_session"} 3
--

Session service duration

Duration of calls to the session service.

Example

# HELP service_session_duration Duration of calls
# TYPE service_session_duration histogram
service_session_duration_bucket{method="create_session",le="0.005"} 3
--

Session service error total

Number of errors encountered by the session service.

Example

# HELP service_session_error_total Number of errors encountered
# TYPE service_session_error_total counter
service_session_error_total{code="not found",method="find_session"} 4

Token service call total

Number of calls to the token service.

Example

# HELP service_token_call_total Number of calls
# TYPE service_token_call_total counter
service_token_call_total{method="delete_authorization"} 3
--

Token service duration

Duration of calls to the token service.

Example

# HELP service_token_duration Duration of calls
# TYPE service_token_duration histogram
service_token_duration_bucket{method="delete_authorization",le="0.005"} 1
--

Token service error total

Number of errors encountered by the token service.

Example

# HELP service_token_error_total Number of errors encountered
# TYPE service_token_error_total counter
service_token_error_total{code="not found",method="delete_authorization"} 1

URM new call total

Number of calls to the URM (unified resource management) creation service.

Example

# HELP service_urm_new_call_total Number of calls
# TYPE service_urm_new_call_total counter
service_urm_new_call_total{method="find_urms"} 6451

urm new duration

Duration of calls to the URM creation service.

Example

# HELP service_urm_new_duration Duration of calls
# TYPE service_urm_new_duration histogram
service_urm_new_duration_bucket{method="find_urms",le="0.005"} 6198
--

User new call total

Number of calls to the user creation service.

Example

# HELP service_user_new_call_total Number of calls
# TYPE service_user_new_call_total counter
service_user_new_call_total{method="find_permission_for_user"} 4806
--

User new duration

Duration of calls to the user creation service.

Example

# HELP service_user_new_duration Duration of calls
# TYPE service_user_new_duration histogram
service_user_new_duration_bucket{method="find_permission_for_user",le="0.005"} 4039
--

InfluxDB storage statistics

To learn how InfluxDB writes, stores, and caches data, see InfluxDB storage engine.

Bucket measurement number

Number of measurements in a bucket.

Example

# HELP storage_bucket_measurement_num Gauge of measurement cardinality per bucket
# TYPE storage_bucket_measurement_num gauge
storage_bucket_measurement_num{bucket="0c3dd7d2d97f4b23"} 4
--

Bucket series number

Number of series in a bucket.

Example

# HELP storage_bucket_series_num Gauge of series cardinality per bucket
# TYPE storage_bucket_series_num gauge
storage_bucket_series_num{bucket="0c3dd7d2d97f4b23"} 38
--

Cache disk bytes

Size (in bytes) of the most recent snapshot.

Example

# HELP storage_cache_disk_bytes Gauge of size of most recent snapshot
# TYPE storage_cache_disk_bytes gauge
storage_cache_disk_bytes{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Cache in use bytes

Current memory consumption (in bytes) of the cache.

Example

# HELP storage_cache_inuse_bytes Gauge of current memory consumption of cache
# TYPE storage_cache_inuse_bytes gauge
storage_cache_inuse_bytes{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Cache latest snapshot

Unix time of the most recent snapshot.

Example

# HELP storage_cache_latest_snapshot Unix time of most recent snapshot
# TYPE storage_cache_latest_snapshot gauge
storage_cache_latest_snapshot{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 1.644269658196893e+09
--

Cache writes with dropped points

Cumulative number of cached writes that had rejected points. Writes with rejected points also increment the write errors counter (storage_cache_writes_err).

Example

# HELP storage_cache_writes_dropped Counter of writes to cache with some dropped points
# TYPE storage_cache_writes_dropped counter
storage_cache_writes_dropped{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Cache writes failed

Cumulative number of cached writes that failed, inclusive of cache writes with dropped points (storage_cache_writes_dropped).

Example

# HELP storage_cache_writes_err Counter of failed writes to cache
# TYPE storage_cache_writes_err counter
storage_cache_writes_err{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Cache writes total

Cumulative number of writes to cache.

Example

# HELP storage_cache_writes_total Counter of all writes to cache
# TYPE storage_cache_writes_total counter
storage_cache_writes_total{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Compactions active

Currently running TSM compactions (by level).

Example

# HELP storage_compactions_active Gauge of compactions (by level) currently running
# TYPE storage_compactions_active gauge
storage_compactions_active{bucket="ec3f82d1de90eddf",engine="tsm1",id="565",level="1",path="/Users/me/.influxdbv2/engine/data/ec3f82d1de90eddf/autogen/565",walPath="/Users/me/.influxdbv2/engine/wal/ec3f82d1de90eddf/autogen/565"} 0
--

Compactions since startup

TSM compactions (by level) since startup.

Example

# HELP storage_compactions_duration_seconds Histogram of compactions by level since startup
# TYPE storage_compactions_duration_seconds histogram
storage_compactions_duration_seconds_bucket{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567",le="60"} 1
storage_compactions_duration_seconds_bucket{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567",le="600"} 1
storage_compactions_duration_seconds_bucket{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567",le="6000"} 1
storage_compactions_duration_seconds_bucket{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567",le="+Inf"} 1
storage_compactions_duration_seconds_sum{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567"} 0.167250668
storage_compactions_duration_seconds_count{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567"} 1
--

Compactions failed

Failed TSM compactions (by level).

Example

# HELP storage_compactions_failed Counter of TSM compactions (by level) that have failed due to error
# TYPE storage_compactions_failed counter
storage_compactions_failed{bucket="ec3f82d1de90eddf",engine="tsm1",id="565",level="1",path="/Users/me/.influxdbv2/engine/data/ec3f82d1de90eddf/autogen/565",walPath="/Users/me/.influxdbv2/engine/wal/ec3f82d1de90eddf/autogen/565"} 0
--

Compactions queued

Queued TSM compactions (by level).

Example

# HELP storage_compactions_queued Counter of TSM compactions (by level) that are currently queued
# TYPE storage_compactions_queued gauge
storage_compactions_queued{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="1",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567"} 0
--

Retention check duration

Retention policy check duration (in seconds).

Example

# HELP storage_retention_check_duration Histogram of duration of retention check (in seconds)
# TYPE storage_retention_check_duration histogram
storage_retention_check_duration_bucket{le="0.005"} 1
storage_retention_check_duration_bucket{le="0.01"} 1
storage_retention_check_duration_bucket{le="0.025"} 1
storage_retention_check_duration_bucket{le="0.05"} 1
storage_retention_check_duration_bucket{le="0.1"} 1
storage_retention_check_duration_bucket{le="0.25"} 1
storage_retention_check_duration_bucket{le="0.5"} 1
storage_retention_check_duration_bucket{le="1"} 1
storage_retention_check_duration_bucket{le="2.5"} 1
storage_retention_check_duration_bucket{le="5"} 1
storage_retention_check_duration_bucket{le="10"} 1
storage_retention_check_duration_bucket{le="+Inf"} 1
storage_retention_check_duration_sum 0.000351857
storage_retention_check_duration_count 1
--

Shard disk size

Disk size (in bytes) of the shard.

Example

# HELP storage_shard_disk_size Gauge of the disk size for the shard
# TYPE storage_shard_disk_size gauge
storage_shard_disk_size{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 4.188743e+06
--

Shard fields created

Number of shard fields created.

Example

# HELP storage_shard_fields_created Counter of the number of fields created
# TYPE storage_shard_fields_created counter
storage_shard_fields_created{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Shard series

Number of series in the shard index.

Example

# HELP storage_shard_series Gauge of the number of series in the shard index
# TYPE storage_shard_series gauge
storage_shard_series{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 38
--

Shard writes

Number of shard write requests.

Example

# HELP storage_shard_write_count Count of the number of write requests
# TYPE storage_shard_write_count counter
storage_shard_write_count{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Shard dropped points

Number of rejected points in shard writes.

Example

# HELP storage_shard_write_dropped_sum Counter of the number of points dropped
# TYPE storage_shard_write_dropped_sum counter
storage_shard_write_dropped_sum{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Shard writes with errors

Number of shard write requests with errors.

Example

# HELP storage_shard_write_err_count Count of the number of write requests with errors
# TYPE storage_shard_write_err_count counter
storage_shard_write_err_count{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Points in shard writes with errors

Number of points in shard write requests with errors.

Example

# HELP storage_shard_write_err_sum Counter of the number of points for write requests with errors
# TYPE storage_shard_write_err_sum counter
storage_shard_write_err_sum{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Points in shard writes

Number of points in shard write requests.

Example

# HELP storage_shard_write_sum Counter of the number of points for write requests
# TYPE storage_shard_write_sum counter
storage_shard_write_sum{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Shard data size

Gauge of the data size (in bytes) for each shard.

Example

# HELP storage_tsm_files_disk_bytes Gauge of data size in bytes for each shard
# TYPE storage_tsm_files_disk_bytes gauge
storage_tsm_files_disk_bytes{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 4.188743e+06
--

Shard files

Number of files per shard.

Example

# HELP storage_tsm_files_total Gauge of number of files per shard
# TYPE storage_tsm_files_total gauge
storage_tsm_files_total{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 1
--

WAL size

WAL size (in bytes).

Example

# HELP storage_wal_size Gauge of size of WAL in bytes
# TYPE storage_wal_size gauge
storage_wal_size{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

WAL write attempts

Cumulative number of write attempts to the WAL.

Example

# HELP storage_wal_writes Number of write attempts to the WAL
# TYPE storage_wal_writes counter
storage_wal_writes{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

WAL failed write attempts

Cumulative number of failed write attempts to the WAL.

Example

# HELP storage_wal_writes_err Number of failed write attempts to the WAL
# TYPE storage_wal_writes_err counter
storage_wal_writes_err{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Points dropped due to partial writes

Number of points dropped due to partial writes.

Example

# HELP storage_writer_dropped_points Histogram of number of points dropped due to partial writes
# TYPE storage_writer_dropped_points histogram
storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="10"} 0
storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="100"} 0
storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="1000"} 0
storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="10000"} 0
storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="100000"} 0
storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="+Inf"} 0
storage_writer_dropped_points_sum{path="/Users/me/.influxdbv2/engine"} 0
storage_writer_dropped_points_count{path="/Users/me/.influxdbv2/engine"} 0
--

Points in shard write requests with errors

Number of points in shard write requests with errors.

Example

# HELP storage_writer_err_points Histogram of number of points in errored shard write requests
# TYPE storage_writer_err_points histogram
storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="10"} 0
storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="100"} 0
storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="1000"} 0
storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="10000"} 0
storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="100000"} 0
storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="+Inf"} 0
storage_writer_err_points_sum{path="/Users/me/.influxdbv2/engine"} 0
storage_writer_err_points_count{path="/Users/me/.influxdbv2/engine"} 0
--

Points in successful shard write requests

Number of points in successful shard write requests.

Example

# HELP storage_writer_ok_points Histogram of number of points in successful shard write requests
# TYPE storage_writer_ok_points histogram
storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="10"} 6
storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="100"} 6
storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="1000"} 8
storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="10000"} 20
storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="100000"} 24
storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="+Inf"} 24
storage_writer_ok_points_sum{path="/Users/me/.influxdbv2/engine"} 125787
storage_writer_ok_points_count{path="/Users/me/.influxdbv2/engine"} 24
--

Points in write requests

Number of points in write requests.

Example

# HELP storage_writer_req_points Histogram of number of points requested to be written
# TYPE storage_writer_req_points histogram
storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="10"} 6
storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="100"} 6
storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="1000"} 6
storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="10000"} 14
storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="100000"} 18
storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="+Inf"} 18
storage_writer_req_points_sum{path="/Users/me/.influxdbv2/engine"} 125787
storage_writer_req_points_count{path="/Users/me/.influxdbv2/engine"} 18
--

Shard write request timeouts

Cumulative number of shard write request timeouts.

Example

# HELP storage_writer_timeouts Number of shard write request timeouts
# TYPE storage_writer_timeouts counter
storage_writer_timeouts{path="/Users/me/.influxdbv2/engine"} 0
--

InfluxDB task statistics

Task executor errors

Number of errors thrown by the executor with the type of error (ex. Invalid, Internal, etc.)

Example

# HELP task_executor_errors_counter The number of errors thrown by the executor with the type of error (ex. Invalid, Internal, etc.)
# TYPE task_executor_errors_counter counter
task_executor_errors_counter{errorType="internal error",task_type="system"} 1183
--

Task executor promise queue usage

Percent of the promise queue that is currently full.

Example

# HELP task_executor_promise_queue_usage Percent of the promise queue that is currently full
# TYPE task_executor_promise_queue_usage gauge
task_executor_promise_queue_usage 0

Task executor run duration

Duration (in seconds) between a task run starting and finishing.

Example

# HELP task_executor_run_duration The duration in seconds between a run starting and finishing.
# TYPE task_executor_run_duration summary

task_executor_run_duration{taskID="08017725990f6000",task_type="",quantile="0.5"} 0.865043855
task_executor_run_duration{taskID="08017725990f6000",task_type="",quantile="0.9"} 0.865043855
task_executor_run_duration{taskID="08017725990f6000",task_type="",quantile="0.99"} 0.865043855
task_executor_run_duration_sum{taskID="08017725990f6000",task_type=""} 1.524920552
task_executor_run_duration_count{taskID="08017725990f6000",task_type=""} 2
--

Task executor run latency seconds

Latency between the task run’s scheduled start time and the execution time, by task type.

Example

# HELP task_executor_run_latency_seconds Records the latency between the time the run was due to run and the time the task started execution, by task type
# TYPE task_executor_run_latency_seconds histogram
task_executor_run_latency_seconds_bucket{task_type="system",le="0.005"} 0
task_executor_run_latency_seconds_bucket{task_type="system",le="0.01"} 0
task_executor_run_latency_seconds_bucket{task_type="system",le="0.025"} 0
task_executor_run_latency_seconds_bucket{task_type="system",le="0.05"} 0
task_executor_run_latency_seconds_bucket{task_type="system",le="0.1"} 0
task_executor_run_latency_seconds_bucket{task_type="system",le="0.25"} 2
task_executor_run_latency_seconds_bucket{task_type="system",le="0.5"} 6
task_executor_run_latency_seconds_bucket{task_type="system",le="1"} 6
task_executor_run_latency_seconds_bucket{task_type="system",le="2.5"} 6
task_executor_run_latency_seconds_bucket{task_type="system",le="5"} 6
task_executor_run_latency_seconds_bucket{task_type="system",le="10"} 6
task_executor_run_latency_seconds_bucket{task_type="system",le="+Inf"} 6
task_executor_run_latency_seconds_sum{task_type="system"} 2.237636
task_executor_run_latency_seconds_count{task_type="system"} 6
--

Task executor run queue delta

Duration (in seconds) between the task run’s scheduled start time and the execution time.

Example

# HELP task_executor_run_queue_delta The duration in seconds between a run being due to start and actually starting.
# TYPE task_executor_run_queue_delta summary
task_executor_run_queue_delta{taskID="08017725990f6000",task_type="",quantile="0.5"} 0.324742
task_executor_run_queue_delta{taskID="08017725990f6000",task_type="",quantile="0.9"} 0.324742
task_executor_run_queue_delta{taskID="08017725990f6000",task_type="",quantile="0.99"} 0.324742
task_executor_run_queue_delta_sum{taskID="08017725990f6000",task_type=""} 0.674875
task_executor_run_queue_delta_count{taskID="08017725990f6000",task_type=""} 2
--

Task executor total runs active

Number of workers currently running tasks.

Example

# HELP task_executor_total_runs_active Total number of workers currently running tasks
# TYPE task_executor_total_runs_active gauge
task_executor_total_runs_active 0

Task executor total runs complete

Number of task runs completed across all tasks, split out by success or failure.

Example

# HELP task_executor_total_runs_complete Total number of runs completed across all tasks, split out by success or failure.
# TYPE task_executor_total_runs_complete counter
task_executor_total_runs_complete{status="failed",task_type="system"} 1384
task_executor_total_runs_complete{status="success",task_type="system"} 6
--

Task executor workers busy

Percent of total available workers that are currently busy.

Example

# HELP task_executor_workers_busy Percent of total available workers that are currently busy
# TYPE task_executor_workers_busy gauge
task_executor_workers_busy 0

Task scheduler current execution

Number of tasks currently being executed.

Example

# HELP task_scheduler_current_execution Number of tasks currently being executed
# TYPE task_scheduler_current_execution gauge
task_scheduler_current_execution 128

Task scheduler execute delta

Duration (in seconds) between a task run starting and finishing.

Example

# HELP task_scheduler_execute_delta The duration in seconds between a run starting and finishing.
# TYPE task_scheduler_execute_delta summary
task_scheduler_execute_delta{quantile="0.5"} NaN
--

Task scheduler schedule delay

Summary of the delay between when a task is scheduled to run and when it is told to execute.

Example

# HELP task_scheduler_schedule_delay The duration between when a Item should be scheduled and when it is told to execute.
# TYPE task_scheduler_schedule_delay summary
task_scheduler_schedule_delay{quantile="0.5"} 120.001036
task_scheduler_schedule_delay{quantile="0.9"} 120.001074
task_scheduler_schedule_delay{quantile="0.99"} 120.001074
task_scheduler_schedule_delay_sum 720.0033010000001
task_scheduler_schedule_delay_count 6
--

Task scheduler total execute failure

Number of times a scheduled task execution has failed.

Example

# HELP task_scheduler_total_execute_failure Total number of times an execution has failed.
# TYPE task_scheduler_total_execute_failure counter
task_scheduler_total_execute_failure 0

Task scheduler total execution calls

Number of scheduled executions across all tasks.

Example

# HELP task_scheduler_total_execution_calls Total number of executions across all tasks.
# TYPE task_scheduler_total_execution_calls counter
task_scheduler_total_execution_calls 4806

Task scheduler total release calls

Number of release requests.

Example

# HELP task_scheduler_total_release_calls Total number of release requests.
# TYPE task_scheduler_total_release_calls counter
task_scheduler_total_release_calls 0

Task scheduler total schedule calls

Number of schedule requests.

Example

# HELP task_scheduler_total_schedule_calls Total number of schedule requests.
# TYPE task_scheduler_total_schedule_calls counter
task_scheduler_total_schedule_calls 6

Task scheduler total schedule fails

Number of schedule requests that fail to schedule.

Example

# HELP task_scheduler_total_schedule_fails Total number of schedule requests that fail to schedule.
# TYPE task_scheduler_total_schedule_fails counter
task_scheduler_total_schedule_fails 0

Was this page helpful?

Thank you for your feedback!


Set your InfluxDB URL

Upgrade to InfluxDB Cloud or InfluxDB 2.0!

InfluxDB Cloud and InfluxDB OSS 2.0 ready for production.