Failure during send_realloc_encrypted_files

[behlendorf]

System information

Type	Version/Name
Distribution Name	Ubuntu
Distribution Version	18.04
Linux Kernel	4.15.0-1041-aws
Architecture	x86_64
ZFS Version	zfs-0.8.0-143-g26b6047
SPL Version

Describe the problem you're observing

[11891.980491] VERIFY3(rrd->bytes_read >= rwa->bytes_read) failed (13585 >= 18446744073709433817)
[11891.986369] PANIC at dmu_recv.c:2472:receive_process_record()
[11891.990306] Showing stack for process 23333
[11891.990311] CPU: 0 PID: 23333 Comm: receive_writer Tainted: P           OE    4.15.0-1041-aws #43-Ubuntu
[11891.990311] Hardware name: Xen HVM domU, BIOS 4.2.amazon 08/24/2006
[11891.990313] Call Trace:
[11891.990322]  dump_stack+0x63/0x8b
[11891.990334]  spl_dumpstack+0x29/0x30 [spl]
[11891.990339]  spl_panic+0xc8/0x110 [spl]
[11891.990343]  ? __slab_free+0x14d/0x2c0
[11891.990345]  ? __slab_free+0x14d/0x2c0
[11891.990352]  ? spl_kmem_free_impl+0x19/0x30 [spl]
[11891.990429]  ? dmu_tx_destroy+0x96/0xb0 [zfs]
[11891.990486]  ? dmu_tx_commit+0x154/0x1c0 [zfs]
[11891.990540]  ? __list_del_entry+0x1d/0x20 [zfs]
[11891.990595]  receive_process_record+0x64/0x1c0 [zfs]
[11891.990648]  receive_writer_thread+0xa1/0x1a0 [zfs]
[11891.990702]  ? receive_process_record+0x1c0/0x1c0 [zfs]
[11891.990713]  thread_generic_wrapper+0x7d/0xc0 [spl]
[11891.990724]  kthread+0x121/0x140

Describe how to reproduce the problem

Observed while running the the ZTS. Also observed on DilOS when running send_realloc_encrypted_files.

Include any warning/errors/backtraces from the system logs

http://build.zfsonlinux.org/builders/Ubuntu%2018.04%20x86_64%20%28TEST%29/builds/4570/steps/shell_9/logs/console

[ahrens]

cc: @pcd1193182 @tcaputi

[ikozhukhov]

ping ? still reproduce this issue

[tcaputi]

I have not been able to reproduce the issue

[ikozhukhov]

i have this issue with full ZTS circle where rsend run after others

[stale]

This issue has been automatically marked as "stale" because it has not had any activity for a while. It will be closed in 90 days if no further activity occurs. Thank you for your contributions.