podman ubuntu error mounting storage for container

[DevinBayly]

Is this a BUG REPORT or FEATURE REQUEST? (leave only one on its own line)

/kind bug

Description
Every time I try to run a podman container I get this issue .

podman run -it --rm docker.io/continuumio/miniconda3
ERRO[0000] error unmounting /home/lil/.config/containers/storage/overlay/cfc5cad4f7d869c5ebec6a7b8eb416d7cd5559b4fbab1d1fcbf3e161c3488001/merged: invalid argument 
Error: error mounting storage for container 1c8e6bc8f0c7cf1a7cbda548e0aac4e346dc4e8c6553503b8e603cd80c695ce3: error creating overlay mount to /home/lil/.config/containers/storage/overlay/cfc5cad4f7d869c5ebec6a7b8eb416d7cd5559b4fbab1d1fcbf3e161c3488001/merged, mount_data="nodev,metacopy=on,lowerdir=/home/lil/.config/containers/storage/overlay/l/VVFM5WOHLWLJPFLKUNDTXHKQZN:/home/lil/.config/containers/storage/overlay/l/RMOFPRUX5ZD7EGQNG4LDEJTNHF:/home/lil/.config/containers/storage/overlay/l/NOATFNAYGEQYXFHMTKGCGJNACA,upperdir=/home/lil/.config/containers/storage/overlay/cfc5cad4f7d869c5ebec6a7b8eb416d7cd5559b4fbab1d1fcbf3e161c3488001/diff,workdir=/home/lil/.config/containers/storage/overlay/cfc5cad4f7d869c5ebec6a7b8eb416d7cd5559b4fbab1d1fcbf3e161c3488001/work,userxattr": invalid argument

Steps to reproduce the issue:

1. podman pull any image

2. attempt podman run -it --rm imagename

Describe the results you received:
the error above with the error mounting the storage

Describe the results you expected:
I expected to go into a terminal, or application depending on the podman container.

Additional info
running as super user restores expected behavior.

Output of podman version:
podman version

Version:      3.1.0
API Version:  3.1.0
Go Version:   go1.15.2
Built:        Wed Dec 31 17:00:00 1969
OS/Arch:      linux/amd64

Output of podman info --debug:

podman info --debug
host:
  arch: amd64
  buildahVersion: 1.20.0
  cgroupManager: cgroupfs
  cgroupVersion: v1
  conmon:
    package: 'conmon: /usr/libexec/podman/conmon'
    path: /usr/libexec/podman/conmon
    version: 'conmon version 2.0.27, commit: '
  cpus: 4
  distribution:
    distribution: ubuntu
    version: "20.04"
  eventLogger: journald
  hostname: vis
  idMappings:
    gidmap:
    - container_id: 0
      host_id: 1000
      size: 1
    - container_id: 1
      host_id: 100000
      size: 65536
    uidmap:
    - container_id: 0
      host_id: 1000
      size: 1
    - container_id: 1
      host_id: 100000
      size: 65536
  kernel: 5.8.0-50-generic
  linkmode: dynamic
  memFree: 697327616
  memTotal: 8247095296
  ociRuntime:
    name: crun
    package: 'crun: /usr/bin/crun'
    path: /usr/bin/crun
    version: |-
      crun version 0.19.3-3385
      commit: 33851ada2cc9bf3945915565bf3c2df97facb92c
      spec: 1.0.0
      +SYSTEMD +SELINUX +APPARMOR +CAP +SECCOMP +EBPF +CRIU +YAJL
  os: linux
  remoteSocket:
    path: /run/user/1000/podman/podman.sock
  security:
    apparmorEnabled: false
    capabilities: CAP_CHOWN,CAP_DAC_OVERRIDE,CAP_FOWNER,CAP_FSETID,CAP_KILL,CAP_NET_BIND_SERVICE,CAP_SETFCAP,CAP_SETGID,CAP_SETPCAP,CAP_SETUID,CAP_SYS_CHROOT
    rootless: true
    seccompEnabled: true
    selinuxEnabled: false
  slirp4netns:
    executable: /usr/bin/slirp4netns
    package: 'slirp4netns: /usr/bin/slirp4netns'
    version: |-
      slirp4netns version 1.1.8
      commit: unknown
      libslirp: 4.3.1-git
      SLIRP_CONFIG_VERSION_MAX: 3
      libseccomp: 2.4.3
  swapFree: 2147479552
  swapTotal: 2147479552
  uptime: 3h 39m 50.75s (Approximately 0.12 days)
registries:
  search:
  - docker.io
  - quay.io
store:
  configFile: /home/lil/.config/containers/storage.conf
  containerStore:
    number: 0
    paused: 0
    running: 0
    stopped: 0
  graphDriverName: overlay
  graphOptions:
    overlay.mountopt: nodev,metacopy=on
  graphRoot: /home/lil/.config/containers/storage
  graphStatus:
    Backing Filesystem: extfs
    Native Overlay Diff: "false"
    Supports d_type: "true"
    Using metacopy: "false"
  imageStore:
    number: 1
  runRoot: /run/user/1000/storage
  volumePath: /home/lil/.config/containers/storage/volumes
version:
  APIVersion: 3.1.0
  Built: 0
  BuiltTime: Wed Dec 31 17:00:00 1969
  GitCommit: ""
  GoVersion: go1.15.2
  OsArch: linux/amd64
  Version: 3.1.0

Package info (e.g. output of rpm -q podman or apt list podman):

apt list podman
Listing... Done
podman/unknown,now 100:3.1.0-3 amd64 [installed]
podman/unknown 100:3.1.0-3 arm64
podman/unknown 100:3.1.0-3 armhf
podman/unknown 100:3.1.0-3 s390x

Have you tested with the latest version of Podman and have you checked the Podman Troubleshooting Guide?

Yes

[tetchel]

looks like containers/buildah#3120

[mheon]

@giuseppe Any chance #10115 fixed this?

[giuseppe]

@mheon hopefully yes. It is the same root reason