dm-integrity.rst 12 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303
  1. ============
  2. dm-integrity
  3. ============
  4. The dm-integrity target emulates a block device that has additional
  5. per-sector tags that can be used for storing integrity information.
  6. A general problem with storing integrity tags with every sector is that
  7. writing the sector and the integrity tag must be atomic - i.e. in case of
  8. crash, either both sector and integrity tag or none of them is written.
  9. To guarantee write atomicity, the dm-integrity target uses journal, it
  10. writes sector data and integrity tags into a journal, commits the journal
  11. and then copies the data and integrity tags to their respective location.
  12. The dm-integrity target can be used with the dm-crypt target - in this
  13. situation the dm-crypt target creates the integrity data and passes them
  14. to the dm-integrity target via bio_integrity_payload attached to the bio.
  15. In this mode, the dm-crypt and dm-integrity targets provide authenticated
  16. disk encryption - if the attacker modifies the encrypted device, an I/O
  17. error is returned instead of random data.
  18. The dm-integrity target can also be used as a standalone target, in this
  19. mode it calculates and verifies the integrity tag internally. In this
  20. mode, the dm-integrity target can be used to detect silent data
  21. corruption on the disk or in the I/O path.
  22. There's an alternate mode of operation where dm-integrity uses a bitmap
  23. instead of a journal. If a bit in the bitmap is 1, the corresponding
  24. region's data and integrity tags are not synchronized - if the machine
  25. crashes, the unsynchronized regions will be recalculated. The bitmap mode
  26. is faster than the journal mode, because we don't have to write the data
  27. twice, but it is also less reliable, because if data corruption happens
  28. when the machine crashes, it may not be detected.
  29. When loading the target for the first time, the kernel driver will format
  30. the device. But it will only format the device if the superblock contains
  31. zeroes. If the superblock is neither valid nor zeroed, the dm-integrity
  32. target can't be loaded.
  33. Accesses to the on-disk metadata area containing checksums (aka tags) are
  34. buffered using dm-bufio. When an access to any given metadata area
  35. occurs, each unique metadata area gets its own buffer(s). The buffer size
  36. is capped at the size of the metadata area, but may be smaller, thereby
  37. requiring multiple buffers to represent the full metadata area. A smaller
  38. buffer size will produce a smaller resulting read/write operation to the
  39. metadata area for small reads/writes. The metadata is still read even in
  40. a full write to the data covered by a single buffer.
  41. To use the target for the first time:
  42. 1. overwrite the superblock with zeroes
  43. 2. load the dm-integrity target with one-sector size, the kernel driver
  44. will format the device
  45. 3. unload the dm-integrity target
  46. 4. read the "provided_data_sectors" value from the superblock
  47. 5. load the dm-integrity target with the target size
  48. "provided_data_sectors"
  49. 6. if you want to use dm-integrity with dm-crypt, load the dm-crypt target
  50. with the size "provided_data_sectors"
  51. Target arguments:
  52. 1. the underlying block device
  53. 2. the number of reserved sector at the beginning of the device - the
  54. dm-integrity won't read of write these sectors
  55. 3. the size of the integrity tag (if "-" is used, the size is taken from
  56. the internal-hash algorithm)
  57. 4. mode:
  58. D - direct writes (without journal)
  59. in this mode, journaling is
  60. not used and data sectors and integrity tags are written
  61. separately. In case of crash, it is possible that the data
  62. and integrity tag doesn't match.
  63. J - journaled writes
  64. data and integrity tags are written to the
  65. journal and atomicity is guaranteed. In case of crash,
  66. either both data and tag or none of them are written. The
  67. journaled mode degrades write throughput twice because the
  68. data have to be written twice.
  69. B - bitmap mode - data and metadata are written without any
  70. synchronization, the driver maintains a bitmap of dirty
  71. regions where data and metadata don't match. This mode can
  72. only be used with internal hash.
  73. R - recovery mode - in this mode, journal is not replayed,
  74. checksums are not checked and writes to the device are not
  75. allowed. This mode is useful for data recovery if the
  76. device cannot be activated in any of the other standard
  77. modes.
  78. 5. the number of additional arguments
  79. Additional arguments:
  80. journal_sectors:number
  81. The size of journal, this argument is used only if formatting the
  82. device. If the device is already formatted, the value from the
  83. superblock is used.
  84. interleave_sectors:number (default 32768)
  85. The number of interleaved sectors. This values is rounded down to
  86. a power of two. If the device is already formatted, the value from
  87. the superblock is used.
  88. meta_device:device
  89. Don't interleave the data and metadata on the device. Use a
  90. separate device for metadata.
  91. buffer_sectors:number (default 128)
  92. The number of sectors in one metadata buffer. The value is rounded
  93. down to a power of two.
  94. journal_watermark:number (default 50)
  95. The journal watermark in percents. When the size of the journal
  96. exceeds this watermark, the thread that flushes the journal will
  97. be started.
  98. commit_time:number (default 10000)
  99. Commit time in milliseconds. When this time passes, the journal is
  100. written. The journal is also written immediately if the FLUSH
  101. request is received.
  102. internal_hash:algorithm(:key) (the key is optional)
  103. Use internal hash or crc.
  104. When this argument is used, the dm-integrity target won't accept
  105. integrity tags from the upper target, but it will automatically
  106. generate and verify the integrity tags.
  107. You can use a crc algorithm (such as crc32), then integrity target
  108. will protect the data against accidental corruption.
  109. You can also use a hmac algorithm (for example
  110. "hmac(sha256):0123456789abcdef"), in this mode it will provide
  111. cryptographic authentication of the data without encryption.
  112. When this argument is not used, the integrity tags are accepted
  113. from an upper layer target, such as dm-crypt. The upper layer
  114. target should check the validity of the integrity tags.
  115. recalculate
  116. Recalculate the integrity tags automatically. It is only valid
  117. when using internal hash.
  118. journal_crypt:algorithm(:key) (the key is optional)
  119. Encrypt the journal using given algorithm to make sure that the
  120. attacker can't read the journal. You can use a block cipher here
  121. (such as "cbc(aes)") or a stream cipher (for example "chacha20"
  122. or "ctr(aes)").
  123. The journal contains history of last writes to the block device,
  124. an attacker reading the journal could see the last sector numbers
  125. that were written. From the sector numbers, the attacker can infer
  126. the size of files that were written. To protect against this
  127. situation, you can encrypt the journal.
  128. journal_mac:algorithm(:key) (the key is optional)
  129. Protect sector numbers in the journal from accidental or malicious
  130. modification. To protect against accidental modification, use a
  131. crc algorithm, to protect against malicious modification, use a
  132. hmac algorithm with a key.
  133. This option is not needed when using internal-hash because in this
  134. mode, the integrity of journal entries is checked when replaying
  135. the journal. Thus, modified sector number would be detected at
  136. this stage.
  137. block_size:number (default 512)
  138. The size of a data block in bytes. The larger the block size the
  139. less overhead there is for per-block integrity metadata.
  140. Supported values are 512, 1024, 2048 and 4096 bytes.
  141. sectors_per_bit:number
  142. In the bitmap mode, this parameter specifies the number of
  143. 512-byte sectors that corresponds to one bitmap bit.
  144. bitmap_flush_interval:number
  145. The bitmap flush interval in milliseconds. The metadata buffers
  146. are synchronized when this interval expires.
  147. allow_discards
  148. Allow block discard requests (a.k.a. TRIM) for the integrity device.
  149. Discards are only allowed to devices using internal hash.
  150. fix_padding
  151. Use a smaller padding of the tag area that is more
  152. space-efficient. If this option is not present, large padding is
  153. used - that is for compatibility with older kernels.
  154. fix_hmac
  155. Improve security of internal_hash and journal_mac:
  156. - the section number is mixed to the mac, so that an attacker can't
  157. copy sectors from one journal section to another journal section
  158. - the superblock is protected by journal_mac
  159. - a 16-byte salt stored in the superblock is mixed to the mac, so
  160. that the attacker can't detect that two disks have the same hmac
  161. key and also to disallow the attacker to move sectors from one
  162. disk to another
  163. legacy_recalculate
  164. Allow recalculating of volumes with HMAC keys. This is disabled by
  165. default for security reasons - an attacker could modify the volume,
  166. set recalc_sector to zero, and the kernel would not detect the
  167. modification.
  168. The journal mode (D/J), buffer_sectors, journal_watermark, commit_time and
  169. allow_discards can be changed when reloading the target (load an inactive
  170. table and swap the tables with suspend and resume). The other arguments
  171. should not be changed when reloading the target because the layout of disk
  172. data depend on them and the reloaded target would be non-functional.
  173. For example, on a device using the default interleave_sectors of 32768, a
  174. block_size of 512, and an internal_hash of crc32c with a tag size of 4
  175. bytes, it will take 128 KiB of tags to track a full data area, requiring
  176. 256 sectors of metadata per data area. With the default buffer_sectors of
  177. 128, that means there will be 2 buffers per metadata area, or 2 buffers
  178. per 16 MiB of data.
  179. Status line:
  180. 1. the number of integrity mismatches
  181. 2. provided data sectors - that is the number of sectors that the user
  182. could use
  183. 3. the current recalculating position (or '-' if we didn't recalculate)
  184. The layout of the formatted block device:
  185. * reserved sectors
  186. (they are not used by this target, they can be used for
  187. storing LUKS metadata or for other purpose), the size of the reserved
  188. area is specified in the target arguments
  189. * superblock (4kiB)
  190. * magic string - identifies that the device was formatted
  191. * version
  192. * log2(interleave sectors)
  193. * integrity tag size
  194. * the number of journal sections
  195. * provided data sectors - the number of sectors that this target
  196. provides (i.e. the size of the device minus the size of all
  197. metadata and padding). The user of this target should not send
  198. bios that access data beyond the "provided data sectors" limit.
  199. * flags
  200. SB_FLAG_HAVE_JOURNAL_MAC
  201. - a flag is set if journal_mac is used
  202. SB_FLAG_RECALCULATING
  203. - recalculating is in progress
  204. SB_FLAG_DIRTY_BITMAP
  205. - journal area contains the bitmap of dirty
  206. blocks
  207. * log2(sectors per block)
  208. * a position where recalculating finished
  209. * journal
  210. The journal is divided into sections, each section contains:
  211. * metadata area (4kiB), it contains journal entries
  212. - every journal entry contains:
  213. * logical sector (specifies where the data and tag should
  214. be written)
  215. * last 8 bytes of data
  216. * integrity tag (the size is specified in the superblock)
  217. - every metadata sector ends with
  218. * mac (8-bytes), all the macs in 8 metadata sectors form a
  219. 64-byte value. It is used to store hmac of sector
  220. numbers in the journal section, to protect against a
  221. possibility that the attacker tampers with sector
  222. numbers in the journal.
  223. * commit id
  224. * data area (the size is variable; it depends on how many journal
  225. entries fit into the metadata area)
  226. - every sector in the data area contains:
  227. * data (504 bytes of data, the last 8 bytes are stored in
  228. the journal entry)
  229. * commit id
  230. To test if the whole journal section was written correctly, every
  231. 512-byte sector of the journal ends with 8-byte commit id. If the
  232. commit id matches on all sectors in a journal section, then it is
  233. assumed that the section was written correctly. If the commit id
  234. doesn't match, the section was written partially and it should not
  235. be replayed.
  236. * one or more runs of interleaved tags and data.
  237. Each run contains:
  238. * tag area - it contains integrity tags. There is one tag for each
  239. sector in the data area. The size of this area is always 4KiB or
  240. greater.
  241. * data area - it contains data sectors. The number of data sectors
  242. in one run must be a power of two. log2 of this value is stored
  243. in the superblock.