allocation-profiling.rst 3.9 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899
  1. .. SPDX-License-Identifier: GPL-2.0
  2. ===========================
  3. MEMORY ALLOCATION PROFILING
  4. ===========================
  5. Low overhead (suitable for production) accounting of all memory allocations,
  6. tracked by file and line number.
  7. Usage:
  8. kconfig options:
  9. - CONFIG_MEM_ALLOC_PROFILING
  10. - CONFIG_MEM_ALLOC_PROFILING_ENABLED_BY_DEFAULT
  11. - CONFIG_MEM_ALLOC_PROFILING_DEBUG
  12. adds warnings for allocations that weren't accounted because of a
  13. missing annotation
  14. Boot parameter:
  15. sysctl.vm.mem_profiling=0|1|never
  16. When set to "never", memory allocation profiling overhead is minimized and it
  17. cannot be enabled at runtime (sysctl becomes read-only).
  18. When CONFIG_MEM_ALLOC_PROFILING_ENABLED_BY_DEFAULT=y, default value is "1".
  19. When CONFIG_MEM_ALLOC_PROFILING_ENABLED_BY_DEFAULT=n, default value is "never".
  20. sysctl:
  21. /proc/sys/vm/mem_profiling
  22. Runtime info:
  23. /proc/allocinfo
  24. Example output::
  25. root@moria-kvm:~# sort -g /proc/allocinfo|tail|numfmt --to=iec
  26. 2.8M 22648 fs/kernfs/dir.c:615 func:__kernfs_new_node
  27. 3.8M 953 mm/memory.c:4214 func:alloc_anon_folio
  28. 4.0M 1010 drivers/staging/ctagmod/ctagmod.c:20 [ctagmod] func:ctagmod_start
  29. 4.1M 4 net/netfilter/nf_conntrack_core.c:2567 func:nf_ct_alloc_hashtable
  30. 6.0M 1532 mm/filemap.c:1919 func:__filemap_get_folio
  31. 8.8M 2785 kernel/fork.c:307 func:alloc_thread_stack_node
  32. 13M 234 block/blk-mq.c:3421 func:blk_mq_alloc_rqs
  33. 14M 3520 mm/mm_init.c:2530 func:alloc_large_system_hash
  34. 15M 3656 mm/readahead.c:247 func:page_cache_ra_unbounded
  35. 55M 4887 mm/slub.c:2259 func:alloc_slab_page
  36. 122M 31168 mm/page_ext.c:270 func:alloc_page_ext
  37. Theory of operation
  38. ===================
  39. Memory allocation profiling builds off of code tagging, which is a library for
  40. declaring static structs (that typically describe a file and line number in
  41. some way, hence code tagging) and then finding and operating on them at runtime,
  42. - i.e. iterating over them to print them in debugfs/procfs.
  43. To add accounting for an allocation call, we replace it with a macro
  44. invocation, alloc_hooks(), that
  45. - declares a code tag
  46. - stashes a pointer to it in task_struct
  47. - calls the real allocation function
  48. - and finally, restores the task_struct alloc tag pointer to its previous value.
  49. This allows for alloc_hooks() calls to be nested, with the most recent one
  50. taking effect. This is important for allocations internal to the mm/ code that
  51. do not properly belong to the outer allocation context and should be counted
  52. separately: for example, slab object extension vectors, or when the slab
  53. allocates pages from the page allocator.
  54. Thus, proper usage requires determining which function in an allocation call
  55. stack should be tagged. There are many helper functions that essentially wrap
  56. e.g. kmalloc() and do a little more work, then are called in multiple places;
  57. we'll generally want the accounting to happen in the callers of these helpers,
  58. not in the helpers themselves.
  59. To fix up a given helper, for example foo(), do the following:
  60. - switch its allocation call to the _noprof() version, e.g. kmalloc_noprof()
  61. - rename it to foo_noprof()
  62. - define a macro version of foo() like so:
  63. #define foo(...) alloc_hooks(foo_noprof(__VA_ARGS__))
  64. It's also possible to stash a pointer to an alloc tag in your own data structures.
  65. Do this when you're implementing a generic data structure that does allocations
  66. "on behalf of" some other code - for example, the rhashtable code. This way,
  67. instead of seeing a large line in /proc/allocinfo for rhashtable.c, we can
  68. break it out by rhashtable type.
  69. To do so:
  70. - Hook your data structure's init function, like any other allocation function.
  71. - Within your init function, use the convenience macro alloc_tag_record() to
  72. record alloc tag in your data structure.
  73. - Then, use the following form for your allocations:
  74. alloc_hooks_tag(ht->your_saved_tag, kmalloc_noprof(...))