| 123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234 |
- .. SPDX-License-Identifier: GPL-2.0
- pstore block oops/panic logger
- ==============================
- Introduction
- ------------
- pstore block (pstore/blk) is an oops/panic logger that writes its logs to a
- block device and non-block device before the system crashes. You can get
- these log files by mounting pstore filesystem like::
- mount -t pstore pstore /sys/fs/pstore
- pstore block concepts
- ---------------------
- pstore/blk provides efficient configuration method for pstore/blk, which
- divides all configurations into two parts, configurations for user and
- configurations for driver.
- Configurations for user determine how pstore/blk works, such as pmsg_size,
- kmsg_size and so on. All of them support both Kconfig and module parameters,
- but module parameters have priority over Kconfig.
- Configurations for driver are all about block device and non-block device,
- such as total_size of block device and read/write operations.
- Configurations for user
- -----------------------
- All of these configurations support both Kconfig and module parameters, but
- module parameters have priority over Kconfig.
- Here is an example for module parameters::
- pstore_blk.blkdev=/dev/mmcblk0p7 pstore_blk.kmsg_size=64 best_effort=y
- The detail of each configurations may be of interest to you.
- blkdev
- ~~~~~~
- The block device to use. Most of the time, it is a partition of block device.
- It's required for pstore/blk. It is also used for MTD device.
- When pstore/blk is built as a module, "blkdev" accepts the following variants:
- 1. /dev/<disk_name> represents the device number of disk
- #. /dev/<disk_name><decimal> represents the device number of partition - device
- number of disk plus the partition number
- #. /dev/<disk_name>p<decimal> - same as the above; this form is used when disk
- name of partitioned disk ends with a digit.
- When pstore/blk is built into the kernel, "blkdev" accepts the following variants:
- #. <hex_major><hex_minor> device number in hexadecimal representation,
- with no leading 0x, for example b302.
- #. PARTUUID=00112233-4455-6677-8899-AABBCCDDEEFF represents the unique id of
- a partition if the partition table provides it. The UUID may be either an
- EFI/GPT UUID, or refer to an MSDOS partition using the format SSSSSSSS-PP,
- where SSSSSSSS is a zero-filled hex representation of the 32-bit
- "NT disk signature", and PP is a zero-filled hex representation of the
- 1-based partition number.
- #. PARTUUID=<UUID>/PARTNROFF=<int> to select a partition in relation to a
- partition with a known unique id.
- #. <major>:<minor> major and minor number of the device separated by a colon.
- It accepts the following variants for MTD device:
- 1. <device name> MTD device name. "pstore" is recommended.
- #. <device number> MTD device number.
- kmsg_size
- ~~~~~~~~~
- The chunk size in KB for oops/panic front-end. It **MUST** be a multiple of 4.
- It's optional if you do not care about the oops/panic log.
- There are multiple chunks for oops/panic front-end depending on the remaining
- space except other pstore front-ends.
- pstore/blk will log to oops/panic chunks one by one, and always overwrite the
- oldest chunk if there is no more free chunk.
- pmsg_size
- ~~~~~~~~~
- The chunk size in KB for pmsg front-end. It **MUST** be a multiple of 4.
- It's optional if you do not care about the pmsg log.
- Unlike oops/panic front-end, there is only one chunk for pmsg front-end.
- Pmsg is a user space accessible pstore object. Writes to */dev/pmsg0* are
- appended to the chunk. On reboot the contents are available in
- */sys/fs/pstore/pmsg-pstore-blk-0*.
- console_size
- ~~~~~~~~~~~~
- The chunk size in KB for console front-end. It **MUST** be a multiple of 4.
- It's optional if you do not care about the console log.
- Similar to pmsg front-end, there is only one chunk for console front-end.
- All log of console will be appended to the chunk. On reboot the contents are
- available in */sys/fs/pstore/console-pstore-blk-0*.
- ftrace_size
- ~~~~~~~~~~~
- The chunk size in KB for ftrace front-end. It **MUST** be a multiple of 4.
- It's optional if you do not care about the ftrace log.
- Similar to oops front-end, there are multiple chunks for ftrace front-end
- depending on the count of cpu processors. Each chunk size is equal to
- ftrace_size / processors_count.
- All log of ftrace will be appended to the chunk. On reboot the contents are
- combined and available in */sys/fs/pstore/ftrace-pstore-blk-0*.
- Persistent function tracing might be useful for debugging software or hardware
- related hangs. Here is an example of usage::
- # mount -t pstore pstore /sys/fs/pstore
- # mount -t debugfs debugfs /sys/kernel/debug/
- # echo 1 > /sys/kernel/debug/pstore/record_ftrace
- # reboot -f
- [...]
- # mount -t pstore pstore /sys/fs/pstore
- # tail /sys/fs/pstore/ftrace-pstore-blk-0
- CPU:0 ts:5914676 c0063828 c0063b94 call_cpuidle <- cpu_startup_entry+0x1b8/0x1e0
- CPU:0 ts:5914678 c039ecdc c006385c cpuidle_enter_state <- call_cpuidle+0x44/0x48
- CPU:0 ts:5914680 c039e9a0 c039ecf0 cpuidle_enter_freeze <- cpuidle_enter_state+0x304/0x314
- CPU:0 ts:5914681 c0063870 c039ea30 sched_idle_set_state <- cpuidle_enter_state+0x44/0x314
- CPU:1 ts:5916720 c0160f59 c015ee04 kernfs_unmap_bin_file <- __kernfs_remove+0x140/0x204
- CPU:1 ts:5916721 c05ca625 c015ee0c __mutex_lock_slowpath <- __kernfs_remove+0x148/0x204
- CPU:1 ts:5916723 c05c813d c05ca630 yield_to <- __mutex_lock_slowpath+0x314/0x358
- CPU:1 ts:5916724 c05ca2d1 c05ca638 __ww_mutex_lock <- __mutex_lock_slowpath+0x31c/0x358
- max_reason
- ~~~~~~~~~~
- Limiting which kinds of kmsg dumps are stored can be controlled via
- the ``max_reason`` value, as defined in include/linux/kmsg_dump.h's
- ``enum kmsg_dump_reason``. For example, to store both Oopses and Panics,
- ``max_reason`` should be set to 2 (KMSG_DUMP_OOPS), to store only Panics
- ``max_reason`` should be set to 1 (KMSG_DUMP_PANIC). Setting this to 0
- (KMSG_DUMP_UNDEF), means the reason filtering will be controlled by the
- ``printk.always_kmsg_dump`` boot param: if unset, it'll be KMSG_DUMP_OOPS,
- otherwise KMSG_DUMP_MAX.
- Configurations for driver
- -------------------------
- A device driver uses ``register_pstore_device`` with
- ``struct pstore_device_info`` to register to pstore/blk.
- .. kernel-doc:: fs/pstore/blk.c
- :export:
- Compression and header
- ----------------------
- Block device is large enough for uncompressed oops data. Actually we do not
- recommend data compression because pstore/blk will insert some information into
- the first line of oops/panic data. For example::
- Panic: Total 16 times
- It means that it's OOPS|Panic for the 16th time since the first booting.
- Sometimes the number of occurrences of oops|panic since the first booting is
- important to judge whether the system is stable.
- The following line is inserted by pstore filesystem. For example::
- Oops#2 Part1
- It means that it's OOPS for the 2nd time on the last boot.
- Reading the data
- ----------------
- The dump data can be read from the pstore filesystem. The format for these
- files is ``dmesg-pstore-blk-[N]`` for oops/panic front-end,
- ``pmsg-pstore-blk-0`` for pmsg front-end and so on. The timestamp of the
- dump file records the trigger time. To delete a stored record from block
- device, simply unlink the respective pstore file.
- Attentions in panic read/write APIs
- -----------------------------------
- If on panic, the kernel is not going to run for much longer, the tasks will not
- be scheduled and most kernel resources will be out of service. It
- looks like a single-threaded program running on a single-core computer.
- The following points require special attention for panic read/write APIs:
- 1. Can **NOT** allocate any memory.
- If you need memory, just allocate while the block driver is initializing
- rather than waiting until the panic.
- #. Must be polled, **NOT** interrupt driven.
- No task schedule any more. The block driver should delay to ensure the write
- succeeds, but NOT sleep.
- #. Can **NOT** take any lock.
- There is no other task, nor any shared resource; you are safe to break all
- locks.
- #. Just use CPU to transfer.
- Do not use DMA to transfer unless you are sure that DMA will not keep lock.
- #. Control registers directly.
- Please control registers directly rather than use Linux kernel resources.
- Do I/O map while initializing rather than wait until a panic occurs.
- #. Reset your block device and controller if necessary.
- If you are not sure of the state of your block device and controller when
- a panic occurs, you are safe to stop and reset them.
- pstore/blk supports psblk_blkdev_info(), which is defined in
- *linux/pstore_blk.h*, to get information of using block device, such as the
- device number, sector count and start sector of the whole disk.
- pstore block internals
- ----------------------
- For developer reference, here are all the important structures and APIs:
- .. kernel-doc:: fs/pstore/zone.c
- :internal:
- .. kernel-doc:: include/linux/pstore_zone.h
- :internal:
- .. kernel-doc:: include/linux/pstore_blk.h
- :internal:
|