Source file src/runtime/metrics/doc.go

     1  // Copyright 2020 The Go Authors. All rights reserved.
     2  // Use of this source code is governed by a BSD-style
     3  // license that can be found in the LICENSE file.
     4  
     5  // Note: run 'go generate' (which will run 'go test -generate') to update the "Supported metrics" list.
     6  //go:generate go test -run=Docs -generate
     7  
     8  /*
     9  Package metrics provides a stable interface to access implementation-defined
    10  metrics exported by the Go runtime. This package is similar to existing functions
    11  like [runtime.ReadMemStats] and [runtime/debug.ReadGCStats], but significantly more general.
    12  
    13  The set of metrics defined by this package may evolve as the runtime itself
    14  evolves, and also enables variation across Go implementations, whose relevant
    15  metric sets may not intersect.
    16  
    17  # Interface
    18  
    19  Metrics are designated by a string key, rather than, for example, a field name in
    20  a struct. The full list of supported metrics is always available in the slice of
    21  Descriptions returned by [All]. Each [Description] also includes useful information
    22  about the metric.
    23  
    24  Thus, users of this API are encouraged to sample supported metrics defined by the
    25  slice returned by All to remain compatible across Go versions. Of course, situations
    26  arise where reading specific metrics is critical. For these cases, users are
    27  encouraged to use build tags, and although metrics may be deprecated and removed,
    28  users should consider this to be an exceptional and rare event, coinciding with a
    29  very large change in a particular Go implementation.
    30  
    31  Each metric key also has a "kind" (see [ValueKind]) that describes the format of the
    32  metric's value.
    33  In the interest of not breaking users of this package, the "kind" for a given metric
    34  is guaranteed not to change. If it must change, then a new metric will be introduced
    35  with a new key and a new "kind."
    36  
    37  # Metric key format
    38  
    39  As mentioned earlier, metric keys are strings. Their format is simple and well-defined,
    40  designed to be both human and machine readable. It is split into two components,
    41  separated by a colon: a rooted path and a unit. The choice to include the unit in
    42  the key is motivated by compatibility: if a metric's unit changes, its semantics likely
    43  did also, and a new key should be introduced.
    44  
    45  For more details on the precise definition of the metric key's path and unit formats, see
    46  the documentation of the Name field of the Description struct.
    47  
    48  # A note about floats
    49  
    50  This package supports metrics whose values have a floating-point representation. In
    51  order to improve ease-of-use, this package promises to never produce the following
    52  classes of floating-point values: NaN, infinity.
    53  
    54  # Supported metrics
    55  
    56  Below is the full list of supported metrics, ordered lexicographically.
    57  
    58  	/cgo/go-to-c-calls:calls
    59  		Count of calls made from Go to C by the current process.
    60  
    61  	/cpu/classes/gc/mark/assist:cpu-seconds
    62  		Estimated total CPU time goroutines spent performing GC
    63  		tasks to assist the GC and prevent it from falling behind the
    64  		application. This metric is an overestimate, and not directly
    65  		comparable to system CPU time measurements. Compare only with
    66  		other /cpu/classes metrics.
    67  
    68  	/cpu/classes/gc/mark/dedicated:cpu-seconds
    69  		Estimated total CPU time spent performing GC tasks on processors
    70  		(as defined by GOMAXPROCS) dedicated to those tasks. This metric
    71  		is an overestimate, and not directly comparable to system CPU
    72  		time measurements. Compare only with other /cpu/classes metrics.
    73  
    74  	/cpu/classes/gc/mark/idle:cpu-seconds
    75  		Estimated total CPU time spent performing GC tasks on spare CPU
    76  		resources that the Go scheduler could not otherwise find a use
    77  		for. This should be subtracted from the total GC CPU time to
    78  		obtain a measure of compulsory GC CPU time. This metric is an
    79  		overestimate, and not directly comparable to system CPU time
    80  		measurements. Compare only with other /cpu/classes metrics.
    81  
    82  	/cpu/classes/gc/pause:cpu-seconds
    83  		Estimated total CPU time spent with the application paused by
    84  		the GC. Even if only one thread is running during the pause,
    85  		this is computed as GOMAXPROCS times the pause latency because
    86  		nothing else can be executing. This is the exact sum of samples
    87  		in /sched/pauses/total/gc:seconds if each sample is multiplied
    88  		by GOMAXPROCS at the time it is taken. This metric is an
    89  		overestimate, and not directly comparable to system CPU time
    90  		measurements. Compare only with other /cpu/classes metrics.
    91  
    92  	/cpu/classes/gc/total:cpu-seconds
    93  		Estimated total CPU time spent performing GC tasks. This metric
    94  		is an overestimate, and not directly comparable to system CPU
    95  		time measurements. Compare only with other /cpu/classes metrics.
    96  		Sum of all metrics in /cpu/classes/gc.
    97  
    98  	/cpu/classes/idle:cpu-seconds
    99  		Estimated total available CPU time not spent executing
   100  		any Go or Go runtime code. In other words, the part of
   101  		/cpu/classes/total:cpu-seconds that was unused. This metric is
   102  		an overestimate, and not directly comparable to system CPU time
   103  		measurements. Compare only with other /cpu/classes metrics.
   104  
   105  	/cpu/classes/scavenge/assist:cpu-seconds
   106  		Estimated total CPU time spent returning unused memory to the
   107  		underlying platform in response eagerly in response to memory
   108  		pressure. This metric is an overestimate, and not directly
   109  		comparable to system CPU time measurements. Compare only with
   110  		other /cpu/classes metrics.
   111  
   112  	/cpu/classes/scavenge/background:cpu-seconds
   113  		Estimated total CPU time spent performing background tasks to
   114  		return unused memory to the underlying platform. This metric is
   115  		an overestimate, and not directly comparable to system CPU time
   116  		measurements. Compare only with other /cpu/classes metrics.
   117  
   118  	/cpu/classes/scavenge/total:cpu-seconds
   119  		Estimated total CPU time spent performing tasks that return
   120  		unused memory to the underlying platform. This metric is an
   121  		overestimate, and not directly comparable to system CPU time
   122  		measurements. Compare only with other /cpu/classes metrics.
   123  		Sum of all metrics in /cpu/classes/scavenge.
   124  
   125  	/cpu/classes/total:cpu-seconds
   126  		Estimated total available CPU time for user Go code or the Go
   127  		runtime, as defined by GOMAXPROCS. In other words, GOMAXPROCS
   128  		integrated over the wall-clock duration this process has been
   129  		executing for. This metric is an overestimate, and not directly
   130  		comparable to system CPU time measurements. Compare only with
   131  		other /cpu/classes metrics. Sum of all metrics in /cpu/classes.
   132  
   133  	/cpu/classes/user:cpu-seconds
   134  		Estimated total CPU time spent running user Go code. This may
   135  		also include some small amount of time spent in the Go runtime.
   136  		This metric is an overestimate, and not directly comparable
   137  		to system CPU time measurements. Compare only with other
   138  		/cpu/classes metrics.
   139  
   140  	/gc/cycles/automatic:gc-cycles
   141  		Count of completed GC cycles generated by the Go runtime.
   142  
   143  	/gc/cycles/forced:gc-cycles
   144  		Count of completed GC cycles forced by the application.
   145  
   146  	/gc/cycles/total:gc-cycles
   147  		Count of all completed GC cycles.
   148  
   149  	/gc/gogc:percent
   150  		Heap size target percentage configured by the user, otherwise
   151  		100. This value is set by the GOGC environment variable, and the
   152  		runtime/debug.SetGCPercent function.
   153  
   154  	/gc/gomemlimit:bytes
   155  		Go runtime memory limit configured by the user, otherwise
   156  		math.MaxInt64. This value is set by the GOMEMLIMIT environment
   157  		variable, and the runtime/debug.SetMemoryLimit function.
   158  
   159  	/gc/heap/allocs-by-size:bytes
   160  		Distribution of heap allocations by approximate size.
   161  		Bucket counts increase monotonically. Note that this does not
   162  		include tiny objects as defined by /gc/heap/tiny/allocs:objects,
   163  		only tiny blocks.
   164  
   165  	/gc/heap/allocs:bytes
   166  		Cumulative sum of memory allocated to the heap by the
   167  		application.
   168  
   169  	/gc/heap/allocs:objects
   170  		Cumulative count of heap allocations triggered by the
   171  		application. Note that this does not include tiny objects as
   172  		defined by /gc/heap/tiny/allocs:objects, only tiny blocks.
   173  
   174  	/gc/heap/frees-by-size:bytes
   175  		Distribution of freed heap allocations by approximate size.
   176  		Bucket counts increase monotonically. Note that this does not
   177  		include tiny objects as defined by /gc/heap/tiny/allocs:objects,
   178  		only tiny blocks.
   179  
   180  	/gc/heap/frees:bytes
   181  		Cumulative sum of heap memory freed by the garbage collector.
   182  
   183  	/gc/heap/frees:objects
   184  		Cumulative count of heap allocations whose storage was freed
   185  		by the garbage collector. Note that this does not include tiny
   186  		objects as defined by /gc/heap/tiny/allocs:objects, only tiny
   187  		blocks.
   188  
   189  	/gc/heap/goal:bytes
   190  		Heap size target for the end of the GC cycle.
   191  
   192  	/gc/heap/live:bytes
   193  		Heap memory occupied by live objects that were marked by the
   194  		previous GC.
   195  
   196  	/gc/heap/objects:objects
   197  		Number of objects, live or unswept, occupying heap memory.
   198  
   199  	/gc/heap/tiny/allocs:objects
   200  		Count of small allocations that are packed together into blocks.
   201  		These allocations are counted separately from other allocations
   202  		because each individual allocation is not tracked by the
   203  		runtime, only their block. Each block is already accounted for
   204  		in allocs-by-size and frees-by-size.
   205  
   206  	/gc/limiter/last-enabled:gc-cycle
   207  		GC cycle the last time the GC CPU limiter was enabled.
   208  		This metric is useful for diagnosing the root cause of an
   209  		out-of-memory error, because the limiter trades memory for CPU
   210  		time when the GC's CPU time gets too high. This is most likely
   211  		to occur with use of SetMemoryLimit. The first GC cycle is cycle
   212  		1, so a value of 0 indicates that it was never enabled.
   213  
   214  	/gc/pauses:seconds
   215  		Deprecated. Prefer the identical /sched/pauses/total/gc:seconds.
   216  
   217  	/gc/scan/globals:bytes
   218  		The total amount of global variable space that is scannable.
   219  
   220  	/gc/scan/heap:bytes
   221  		The total amount of heap space that is scannable.
   222  
   223  	/gc/scan/stack:bytes
   224  		The number of bytes of stack that were scanned last GC cycle.
   225  
   226  	/gc/scan/total:bytes
   227  		The total amount space that is scannable. Sum of all metrics in
   228  		/gc/scan.
   229  
   230  	/gc/stack/starting-size:bytes
   231  		The stack size of new goroutines.
   232  
   233  	/godebug/non-default-behavior/allowmultiplevcs:events
   234  		The number of non-default behaviors executed by the cmd/go
   235  		package due to a non-default GODEBUG=allowmultiplevcs=...
   236  		setting.
   237  
   238  	/godebug/non-default-behavior/asynctimerchan:events
   239  		The number of non-default behaviors executed by the time package
   240  		due to a non-default GODEBUG=asynctimerchan=... setting.
   241  
   242  	/godebug/non-default-behavior/containermaxprocs:events
   243  		The number of non-default behaviors executed by the runtime
   244  		package due to a non-default GODEBUG=containermaxprocs=...
   245  		setting.
   246  
   247  	/godebug/non-default-behavior/embedfollowsymlinks:events
   248  		The number of non-default behaviors executed by the cmd/go
   249  		package due to a non-default GODEBUG=embedfollowsymlinks=...
   250  		setting.
   251  
   252  	/godebug/non-default-behavior/execerrdot:events
   253  		The number of non-default behaviors executed by the os/exec
   254  		package due to a non-default GODEBUG=execerrdot=... setting.
   255  
   256  	/godebug/non-default-behavior/gocachehash:events
   257  		The number of non-default behaviors executed by the cmd/go
   258  		package due to a non-default GODEBUG=gocachehash=... setting.
   259  
   260  	/godebug/non-default-behavior/gocachetest:events
   261  		The number of non-default behaviors executed by the cmd/go
   262  		package due to a non-default GODEBUG=gocachetest=... setting.
   263  
   264  	/godebug/non-default-behavior/gocacheverify:events
   265  		The number of non-default behaviors executed by the cmd/go
   266  		package due to a non-default GODEBUG=gocacheverify=... setting.
   267  
   268  	/godebug/non-default-behavior/gotestjsonbuildtext:events
   269  		The number of non-default behaviors executed by the cmd/go
   270  		package due to a non-default GODEBUG=gotestjsonbuildtext=...
   271  		setting.
   272  
   273  	/godebug/non-default-behavior/gotypesalias:events
   274  		The number of non-default behaviors executed by the go/types
   275  		package due to a non-default GODEBUG=gotypesalias=... setting.
   276  
   277  	/godebug/non-default-behavior/http2client:events
   278  		The number of non-default behaviors executed by the net/http
   279  		package due to a non-default GODEBUG=http2client=... setting.
   280  
   281  	/godebug/non-default-behavior/http2server:events
   282  		The number of non-default behaviors executed by the net/http
   283  		package due to a non-default GODEBUG=http2server=... setting.
   284  
   285  	/godebug/non-default-behavior/httplaxcontentlength:events
   286  		The number of non-default behaviors executed by the net/http
   287  		package due to a non-default GODEBUG=httplaxcontentlength=...
   288  		setting.
   289  
   290  	/godebug/non-default-behavior/httpmuxgo121:events
   291  		The number of non-default behaviors executed by the net/http
   292  		package due to a non-default GODEBUG=httpmuxgo121=... setting.
   293  
   294  	/godebug/non-default-behavior/httpservecontentkeepheaders:events
   295  		The number of non-default behaviors executed
   296  		by the net/http package due to a non-default
   297  		GODEBUG=httpservecontentkeepheaders=... setting.
   298  
   299  	/godebug/non-default-behavior/installgoroot:events
   300  		The number of non-default behaviors executed by the go/build
   301  		package due to a non-default GODEBUG=installgoroot=... setting.
   302  
   303  	/godebug/non-default-behavior/multipartmaxheaders:events
   304  		The number of non-default behaviors executed by
   305  		the mime/multipart package due to a non-default
   306  		GODEBUG=multipartmaxheaders=... setting.
   307  
   308  	/godebug/non-default-behavior/multipartmaxparts:events
   309  		The number of non-default behaviors executed by
   310  		the mime/multipart package due to a non-default
   311  		GODEBUG=multipartmaxparts=... setting.
   312  
   313  	/godebug/non-default-behavior/multipathtcp:events
   314  		The number of non-default behaviors executed by the net package
   315  		due to a non-default GODEBUG=multipathtcp=... setting.
   316  
   317  	/godebug/non-default-behavior/netedns0:events
   318  		The number of non-default behaviors executed by the net package
   319  		due to a non-default GODEBUG=netedns0=... setting.
   320  
   321  	/godebug/non-default-behavior/panicnil:events
   322  		The number of non-default behaviors executed by the runtime
   323  		package due to a non-default GODEBUG=panicnil=... setting.
   324  
   325  	/godebug/non-default-behavior/randautoseed:events
   326  		The number of non-default behaviors executed by the math/rand
   327  		package due to a non-default GODEBUG=randautoseed=... setting.
   328  
   329  	/godebug/non-default-behavior/randseednop:events
   330  		The number of non-default behaviors executed by the math/rand
   331  		package due to a non-default GODEBUG=randseednop=... setting.
   332  
   333  	/godebug/non-default-behavior/rsa1024min:events
   334  		The number of non-default behaviors executed by the crypto/rsa
   335  		package due to a non-default GODEBUG=rsa1024min=... setting.
   336  
   337  	/godebug/non-default-behavior/tarinsecurepath:events
   338  		The number of non-default behaviors executed by the archive/tar
   339  		package due to a non-default GODEBUG=tarinsecurepath=...
   340  		setting.
   341  
   342  	/godebug/non-default-behavior/tls10server:events
   343  		The number of non-default behaviors executed by the crypto/tls
   344  		package due to a non-default GODEBUG=tls10server=... setting.
   345  
   346  	/godebug/non-default-behavior/tls3des:events
   347  		The number of non-default behaviors executed by the crypto/tls
   348  		package due to a non-default GODEBUG=tls3des=... setting.
   349  
   350  	/godebug/non-default-behavior/tlsmaxrsasize:events
   351  		The number of non-default behaviors executed by the crypto/tls
   352  		package due to a non-default GODEBUG=tlsmaxrsasize=... setting.
   353  
   354  	/godebug/non-default-behavior/tlsrsakex:events
   355  		The number of non-default behaviors executed by the crypto/tls
   356  		package due to a non-default GODEBUG=tlsrsakex=... setting.
   357  
   358  	/godebug/non-default-behavior/tlssha1:events
   359  		The number of non-default behaviors executed by the crypto/tls
   360  		package due to a non-default GODEBUG=tlssha1=... setting.
   361  
   362  	/godebug/non-default-behavior/tlsunsafeekm:events
   363  		The number of non-default behaviors executed by the crypto/tls
   364  		package due to a non-default GODEBUG=tlsunsafeekm=... setting.
   365  
   366  	/godebug/non-default-behavior/updatemaxprocs:events
   367  		The number of non-default behaviors executed by the runtime
   368  		package due to a non-default GODEBUG=updatemaxprocs=... setting.
   369  
   370  	/godebug/non-default-behavior/winreadlinkvolume:events
   371  		The number of non-default behaviors executed by the os package
   372  		due to a non-default GODEBUG=winreadlinkvolume=... setting.
   373  
   374  	/godebug/non-default-behavior/winsymlink:events
   375  		The number of non-default behaviors executed by the os package
   376  		due to a non-default GODEBUG=winsymlink=... setting.
   377  
   378  	/godebug/non-default-behavior/x509keypairleaf:events
   379  		The number of non-default behaviors executed by the crypto/tls
   380  		package due to a non-default GODEBUG=x509keypairleaf=...
   381  		setting.
   382  
   383  	/godebug/non-default-behavior/x509negativeserial:events
   384  		The number of non-default behaviors executed by the crypto/x509
   385  		package due to a non-default GODEBUG=x509negativeserial=...
   386  		setting.
   387  
   388  	/godebug/non-default-behavior/x509rsacrt:events
   389  		The number of non-default behaviors executed by the crypto/x509
   390  		package due to a non-default GODEBUG=x509rsacrt=... setting.
   391  
   392  	/godebug/non-default-behavior/x509sha256skid:events
   393  		The number of non-default behaviors executed by the crypto/x509
   394  		package due to a non-default GODEBUG=x509sha256skid=... setting.
   395  
   396  	/godebug/non-default-behavior/x509usefallbackroots:events
   397  		The number of non-default behaviors executed by the crypto/x509
   398  		package due to a non-default GODEBUG=x509usefallbackroots=...
   399  		setting.
   400  
   401  	/godebug/non-default-behavior/x509usepolicies:events
   402  		The number of non-default behaviors executed by the crypto/x509
   403  		package due to a non-default GODEBUG=x509usepolicies=...
   404  		setting.
   405  
   406  	/godebug/non-default-behavior/zipinsecurepath:events
   407  		The number of non-default behaviors executed by the archive/zip
   408  		package due to a non-default GODEBUG=zipinsecurepath=...
   409  		setting.
   410  
   411  	/memory/classes/heap/free:bytes
   412  		Memory that is completely free and eligible to be returned to
   413  		the underlying system, but has not been. This metric is the
   414  		runtime's estimate of free address space that is backed by
   415  		physical memory.
   416  
   417  	/memory/classes/heap/objects:bytes
   418  		Memory occupied by live objects and dead objects that have not
   419  		yet been marked free by the garbage collector.
   420  
   421  	/memory/classes/heap/released:bytes
   422  		Memory that is completely free and has been returned to the
   423  		underlying system. This metric is the runtime's estimate of free
   424  		address space that is still mapped into the process, but is not
   425  		backed by physical memory.
   426  
   427  	/memory/classes/heap/stacks:bytes
   428  		Memory allocated from the heap that is reserved for stack space,
   429  		whether or not it is currently in-use. Currently, this
   430  		represents all stack memory for goroutines. It also includes all
   431  		OS thread stacks in non-cgo programs. Note that stacks may be
   432  		allocated differently in the future, and this may change.
   433  
   434  	/memory/classes/heap/unused:bytes
   435  		Memory that is reserved for heap objects but is not currently
   436  		used to hold heap objects.
   437  
   438  	/memory/classes/metadata/mcache/free:bytes
   439  		Memory that is reserved for runtime mcache structures, but not
   440  		in-use.
   441  
   442  	/memory/classes/metadata/mcache/inuse:bytes
   443  		Memory that is occupied by runtime mcache structures that are
   444  		currently being used.
   445  
   446  	/memory/classes/metadata/mspan/free:bytes
   447  		Memory that is reserved for runtime mspan structures, but not
   448  		in-use.
   449  
   450  	/memory/classes/metadata/mspan/inuse:bytes
   451  		Memory that is occupied by runtime mspan structures that are
   452  		currently being used.
   453  
   454  	/memory/classes/metadata/other:bytes
   455  		Memory that is reserved for or used to hold runtime metadata.
   456  
   457  	/memory/classes/os-stacks:bytes
   458  		Stack memory allocated by the underlying operating system.
   459  		In non-cgo programs this metric is currently zero. This may
   460  		change in the future.In cgo programs this metric includes
   461  		OS thread stacks allocated directly from the OS. Currently,
   462  		this only accounts for one stack in c-shared and c-archive build
   463  		modes, and other sources of stacks from the OS are not measured.
   464  		This too may change in the future.
   465  
   466  	/memory/classes/other:bytes
   467  		Memory used by execution trace buffers, structures for debugging
   468  		the runtime, finalizer and profiler specials, and more.
   469  
   470  	/memory/classes/profiling/buckets:bytes
   471  		Memory that is used by the stack trace hash map used for
   472  		profiling.
   473  
   474  	/memory/classes/total:bytes
   475  		All memory mapped by the Go runtime into the current process
   476  		as read-write. Note that this does not include memory mapped
   477  		by code called via cgo or via the syscall package. Sum of all
   478  		metrics in /memory/classes.
   479  
   480  	/sched/gomaxprocs:threads
   481  		The current runtime.GOMAXPROCS setting, or the number of
   482  		operating system threads that can execute user-level Go code
   483  		simultaneously.
   484  
   485  	/sched/goroutines:goroutines
   486  		Count of live goroutines.
   487  
   488  	/sched/latencies:seconds
   489  		Distribution of the time goroutines have spent in the scheduler
   490  		in a runnable state before actually running. Bucket counts
   491  		increase monotonically.
   492  
   493  	/sched/pauses/stopping/gc:seconds
   494  		Distribution of individual GC-related stop-the-world stopping
   495  		latencies. This is the time it takes from deciding to stop the
   496  		world until all Ps are stopped. This is a subset of the total
   497  		GC-related stop-the-world time (/sched/pauses/total/gc:seconds).
   498  		During this time, some threads may be executing. Bucket counts
   499  		increase monotonically.
   500  
   501  	/sched/pauses/stopping/other:seconds
   502  		Distribution of individual non-GC-related stop-the-world
   503  		stopping latencies. This is the time it takes from deciding
   504  		to stop the world until all Ps are stopped. This is a
   505  		subset of the total non-GC-related stop-the-world time
   506  		(/sched/pauses/total/other:seconds). During this time, some
   507  		threads may be executing. Bucket counts increase monotonically.
   508  
   509  	/sched/pauses/total/gc:seconds
   510  		Distribution of individual GC-related stop-the-world pause
   511  		latencies. This is the time from deciding to stop the world
   512  		until the world is started again. Some of this time is spent
   513  		getting all threads to stop (this is measured directly in
   514  		/sched/pauses/stopping/gc:seconds), during which some threads
   515  		may still be running. Bucket counts increase monotonically.
   516  
   517  	/sched/pauses/total/other:seconds
   518  		Distribution of individual non-GC-related stop-the-world
   519  		pause latencies. This is the time from deciding to stop the
   520  		world until the world is started again. Some of this time
   521  		is spent getting all threads to stop (measured directly in
   522  		/sched/pauses/stopping/other:seconds). Bucket counts increase
   523  		monotonically.
   524  
   525  	/sync/mutex/wait/total:seconds
   526  		Approximate cumulative time goroutines have spent blocked on a
   527  		sync.Mutex, sync.RWMutex, or runtime-internal lock. This metric
   528  		is useful for identifying global changes in lock contention.
   529  		Collect a mutex or block profile using the runtime/pprof package
   530  		for more detailed contention data.
   531  */
   532  package metrics
   533  

View as plain text