Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

libuzfs && uzfs: reimplement attr/xattr store using zfs sa and add tests #11

Merged
merged 1 commit into from
Dec 30, 2022

Conversation

sundengyu
Copy link

the old implementation has poor compatibility when adding new attribute to file system, and waste space when storing xattr,
this pr use zfs sa to solve that problem

Copy link

@hpingfs hpingfs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some comments so far.

cmd/uzfs/uzfs.c Outdated Show resolved Hide resolved
cmd/uzfs/uzfs.c Show resolved Hide resolved
include/libuzfs_impl.h Outdated Show resolved Hide resolved
cmd/uzfs/uzfs.c Outdated Show resolved Hide resolved
include/libuzfs.h Outdated Show resolved Hide resolved
lib/libuzfs/libuzfs_attr.c Outdated Show resolved Hide resolved
lib/libuzfs/libuzfs_attr.c Outdated Show resolved Hide resolved
@sundengyu sundengyu force-pushed the uzfs-dev-sa branch 3 times, most recently from da74388 to 4f331b4 Compare December 23, 2022 03:35
lib/libuzfs/libuzfs_attr.c Outdated Show resolved Hide resolved
lib/libuzfs/libuzfs_attr.c Outdated Show resolved Hide resolved
lib/libuzfs/libuzfs_attr.c Outdated Show resolved Hide resolved
lib/libuzfs/libuzfs_attr.c Outdated Show resolved Hide resolved
lib/libuzfs/libuzfs_attr.c Outdated Show resolved Hide resolved
lib/libuzfs/libuzfs_attr.c Outdated Show resolved Hide resolved
lib/libuzfs/libuzfs_attr.c Outdated Show resolved Hide resolved
lib/libuzfs/libuzfs_attr.c Outdated Show resolved Hide resolved
lib/libuzfs/libuzfs_attr.c Show resolved Hide resolved
lib/libuzfs/libuzfs_attr.c Outdated Show resolved Hide resolved
@hpingfs hpingfs requested a review from kylezh December 23, 2022 10:09
@sundengyu sundengyu force-pushed the uzfs-dev-sa branch 9 times, most recently from 018e214 to 54b8718 Compare December 27, 2022 07:04
cmd/uzfs/uzfs.c Show resolved Hide resolved
lib/libuzfs/libuzfs_attr.c Outdated Show resolved Hide resolved
lib/libuzfs/libuzfs_attr.c Show resolved Hide resolved
lib/libuzfs/libuzfs_attr.c Outdated Show resolved Hide resolved
lib/libuzfs/libuzfs_attr.c Outdated Show resolved Hide resolved
lib/libuzfs/libuzfs_attr.c Outdated Show resolved Hide resolved
lib/libuzfs/libuzfs_attr.c Outdated Show resolved Hide resolved
@sundengyu sundengyu force-pushed the uzfs-dev-sa branch 3 times, most recently from aebbcc3 to 2366a45 Compare December 28, 2022 03:19
lib/libuzfs/libuzfs_attr.c Outdated Show resolved Hide resolved
lib/libuzfs/libuzfs_attr.c Show resolved Hide resolved
lib/libuzfs/libuzfs_attr.c Outdated Show resolved Hide resolved
@sundengyu sundengyu force-pushed the uzfs-dev-sa branch 3 times, most recently from 2e1b3eb to 0196a9a Compare December 28, 2022 05:57
lib/libuzfs/libuzfs.c Outdated Show resolved Hide resolved
cmd/uzfs/uzfs.c Outdated Show resolved Hide resolved
lib/libuzfs/libuzfs_attr.c Outdated Show resolved Hide resolved
@sundengyu sundengyu force-pushed the uzfs-dev-sa branch 3 times, most recently from 8c5b367 to 9b3e371 Compare December 28, 2022 09:53
@hpingfs hpingfs assigned hpingfs and unassigned hpingfs Dec 29, 2022
@hpingfs
Copy link

hpingfs commented Dec 29, 2022

Since the attr and kvattr interface changes, libuzfs-rs should be also updated.
Don't merge this patch until libuzfs-rs change is ready.

@hpingfs hpingfs merged commit 00ff0ef into uzfs-dev Dec 30, 2022
@hpingfs hpingfs deleted the uzfs-dev-sa branch December 30, 2022 05:52
sundengyu pushed a commit that referenced this pull request Dec 25, 2023
Under certain loads, the following panic is hit:

    panic: page fault
    KDB: stack backtrace:
    #0 0xffffffff805db025 at kdb_backtrace+0x65
    #1 0xffffffff8058e86f at vpanic+0x17f
    #2 0xffffffff8058e6e3 at panic+0x43
    #3 0xffffffff808adc15 at trap_fatal+0x385
    #4 0xffffffff808adc6f at trap_pfault+0x4f
    #5 0xffffffff80886da8 at calltrap+0x8
    #6 0xffffffff80669186 at vgonel+0x186
    #7 0xffffffff80669841 at vgone+0x31
    #8 0xffffffff8065806d at vfs_hash_insert+0x26d
    #9 0xffffffff81a39069 at sfs_vgetx+0x149
    #10 0xffffffff81a39c54 at zfsctl_snapdir_lookup+0x1e4
    #11 0xffffffff8065a28c at lookup+0x45c
    #12 0xffffffff806594b9 at namei+0x259
    #13 0xffffffff80676a33 at kern_statat+0xf3
    #14 0xffffffff8067712f at sys_fstatat+0x2f
    #15 0xffffffff808ae50c at amd64_syscall+0x10c
    #16 0xffffffff808876bb at fast_syscall_common+0xf8

The page fault occurs because vgonel() will call VOP_CLOSE() for active
vnodes. For this reason, define vop_close for zfsctl_ops_snapshot. While
here, define vop_open for consistency.

After adding the necessary vop, the bug progresses to the following
panic:

    panic: VERIFY3(vrecycle(vp) == 1) failed (0 == 1)
    cpuid = 17
    KDB: stack backtrace:
    #0 0xffffffff805e29c5 at kdb_backtrace+0x65
    #1 0xffffffff8059620f at vpanic+0x17f
    #2 0xffffffff81a27f4a at spl_panic+0x3a
    #3 0xffffffff81a3a4d0 at zfsctl_snapshot_inactive+0x40
    #4 0xffffffff8066fdee at vinactivef+0xde
    #5 0xffffffff80670b8a at vgonel+0x1ea
    #6 0xffffffff806711e1 at vgone+0x31
    #7 0xffffffff8065fa0d at vfs_hash_insert+0x26d
    #8 0xffffffff81a39069 at sfs_vgetx+0x149
    #9 0xffffffff81a39c54 at zfsctl_snapdir_lookup+0x1e4
    #10 0xffffffff80661c2c at lookup+0x45c
    #11 0xffffffff80660e59 at namei+0x259
    #12 0xffffffff8067e3d3 at kern_statat+0xf3
    #13 0xffffffff8067eacf at sys_fstatat+0x2f
    #14 0xffffffff808b5ecc at amd64_syscall+0x10c
    #15 0xffffffff8088f07b at fast_syscall_common+0xf8

This is caused by a race condition that can occur when allocating a new
vnode and adding that vnode to the vfs hash. If the newly created vnode
loses the race when being inserted into the vfs hash, it will not be
recycled as its usecount is greater than zero, hitting the above
assertion.

Fix this by dropping the assertion.

FreeBSD-issue: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=252700
Reviewed-by: Andriy Gapon <avg@FreeBSD.org>
Reviewed-by: Mateusz Guzik <mjguzik@gmail.com>
Reviewed-by: Alek Pinchuk <apinchuk@axcient.com>
Reviewed-by: Ryan Moeller <ryan@iXsystems.com>
Signed-off-by: Rob Wing <rob.wing@klarasystems.com>
Co-authored-by: Rob Wing <rob.wing@klarasystems.com>
Submitted-by: Klara, Inc.
Sponsored-by: rsync.net
Closes openzfs#14501
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants