Volume get detached after error with osxfs notifications #2777

waj · 2018-04-06T20:34:36Z

I was having an issue with an Elixir/Phoenix project and after some time debugging and reducing the problem I finally got something minimal that can be easily reproduced.

This started to happen after I upgraded to Docker for Mac Version 18.03.0-ce-mac60 (23751).
Diagnostics ID: CF39864B-6DD4-477F-99A6-6455DC6EC617

The problem is that sometimes a Docker volume gets detached. Here's an example to reproduce the issue:

docker-compose.yml:

version: '2'
volumes:
  vol:

services:
  app:
    build: .
    working_dir: /app
    volumes:
      - './:/app'
      - 'vol:/app/vol'

Dockerfile:

FROM debian:jessie

RUN \
  apt-get update && \
  DEBIAN_FRONTEND=noninteractive apt-get install -y inotify-tools && \
  apt-get clean && rm -rf /var/lib/apt/lists/* /tmp/* /var/tmp/*

First, I start the container and confirm that the volume is mounted:

$ docker-compose run --rm app bash
root@d1bad28a1d5a:/app# mount | grep vol
/dev/sda1 on /app/vol type ext4 (rw,relatime,stripe=1024,data=ordered)

Now I start inotifywait to listen to some events on the /app directory (mounted from host)

root@d1bad28a1d5a:/app# inotifywait -m -r .
Setting up watches.  Beware: since -r was given, this may take a while!
Watches established.

On another terminal, in the host I run this command to rapidly create and delete files:

$ while true; do touch foo; rm foo; done

In the container I can see the notifications flooding the screen:

./ DELETE foo
./ CREATE foo
./ CREATE foo
./ DELETE foo
...

However at the same time, I can see in the Console.app logs coming from the com.docker.osxfs process complaining about missed files:

transfused: Event unlink /Users/waj/docker-foo/foo error: No such file or directory

Once that happen (very quickly indeed), in the container I cancel the inotifywait session and verify that the volume is not mounted anymore:

root@d1bad28a1d5a:/app# mount | grep vol
root@d1bad28a1d5a:/app#

The text was updated successfully, but these errors were encountered:

rchomat · 2018-04-13T09:29:01Z

#2019 may be linked to this one ?

artyfarty · 2018-04-24T17:21:33Z

Volumes that suddenly dismount or stop updating correctly is a common problem for me and my coworkers. No idea how to fix this for now. docker-sync is nice but has its own stability issues

artyfarty · 2018-04-24T17:24:03Z

By the way. Why mount shows

osxfs on /***** type fuse.osxfs (rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other,max_read=1048576)

Why max_read=1048576? Isn't it a problem?

max_read=N
With this option the maximum size of read operations can be set. The default is infinite. Note that the size of read requests is limited anyway to 32 pages (which is 128kbyte on i386).

WHY

waj · 2018-04-27T21:35:21Z

I can confirm this is still happening with Docker for Mac Version 18.03.1-ce-mac64 (24245)

paschdan · 2018-06-06T14:36:50Z

I can confirm this happens on Version 18.05.0-ce-mac66 (24545)

docker-robott · 2018-09-04T04:00:22Z

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale comment.
Stale issues will be closed after an additional 30d of inactivity.

Prevent issues from auto-closing with an /lifecycle frozen comment.

If this issue is safe to close now please do so.

Send feedback to Docker Community Slack channels #docker-for-mac or #docker-for-windows.
/lifecycle stale

artyfarty · 2018-09-04T17:32:59Z

The problem persists. /remove-lifecycle stale

paschdan · 2018-09-05T08:52:49Z

/remove-lifecycle stale

docker-robott · 2018-12-04T02:00:24Z

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale comment.
Stale issues will be closed after an additional 30d of inactivity.

Prevent issues from auto-closing with an /lifecycle frozen comment.

If this issue is safe to close now please do so.

Send feedback to Docker Community Slack channels #docker-for-mac or #docker-for-windows.
/lifecycle stale

artyfarty · 2018-12-04T15:32:05Z

/remove-lifecycle stale

waj · 2019-01-31T21:37:16Z

I just tested this on Docker for Mac Version 2.0.0.2 (30215), and still happening. This is really annoying. Is there any way I can contribute to fix this issue? I'm pretty sure it's something related with osxfs and the forwarding of inotify events. Is that code open source?

docker-robott · 2019-05-01T01:00:24Z

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale comment.
Stale issues will be closed after an additional 30d of inactivity.

Prevent issues from auto-closing with an /lifecycle frozen comment.

If this issue is safe to close now please do so.

Send feedback to Docker Community Slack channels #docker-for-mac or #docker-for-windows.
/lifecycle stale

nguyenvietyen · 2019-05-01T06:13:55Z

/remove-lifecycle stale

waj · 2019-06-21T17:36:38Z

/remove-lifecycle stale

waj · 2019-08-08T19:38:36Z

Just upgraded to Docker Desktop 2.1.0.1 (37199) and still the same problem.

macrael · 2019-10-13T17:58:44Z

I think I may be having the same problem.

 --mount type=volume,source=code-node,destination=/code/node_modules/ \
 --mount type=bind,source="$(pwd)",destination=/code \

I can reliably make the node_modules volume get unmounted simply by running touch node_modules on the host.

This seems wrong!

docker-robott · 2020-01-11T01:00:16Z

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale comment.
Stale issues will be closed after an additional 30d of inactivity.

Prevent issues from auto-closing with an /lifecycle frozen comment.

If this issue is safe to close now please do so.

Send feedback to Docker Community Slack channels #docker-for-mac or #docker-for-windows.
/lifecycle stale

artyfarty · 2020-01-11T08:25:00Z

/remove-lifecycle stale
Thou shalth not silence Us, Machine.

docker-robott · 2020-04-10T01:00:09Z

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale comment.
Stale issues will be closed after an additional 30d of inactivity.

Prevent issues from auto-closing with an /lifecycle frozen comment.

If this issue is safe to close now please do so.

Send feedback to Docker Community Slack channels #docker-for-mac or #docker-for-windows.
/lifecycle stale

waj · 2020-04-16T01:16:44Z

/remove-lifecycle stale

waj · 2020-04-16T01:19:47Z

Still happening with Docker for Mac 2.2.0.5
2 years now with this really annoying bug reported multiple times: #3479, #3976, #2019, moby/moby#40109

kurko · 2020-06-16T22:50:40Z

2.3.0.3 as well.

docker-robott · 2020-09-14T01:00:07Z

Issues go stale after 90 days of inactivity.
Mark the issue as fresh with /remove-lifecycle stale comment.
Stale issues will be closed after an additional 30 days of inactivity.

Prevent issues from auto-closing with an /lifecycle frozen comment.

If this issue is safe to close now please do so.

Send feedback to Docker Community Slack channels #docker-for-mac or #docker-for-windows.
/lifecycle stale

artyfarty · 2020-09-14T08:39:53Z

/remove-lifecycle stale
/lifecycle frozen

At least this issue is stable in this endless cycle of being marked as stale shortly after somebody tells that it still exists.

daveisfera · 2020-09-14T13:15:17Z

I just tried this with 2.3.6.1 and could not reproduce the issue so I believe that the issues with event notifications have been fixed in the edge build

docker-robott added the lifecycle/stale label Sep 4, 2018

docker-robott removed the lifecycle/stale label Sep 5, 2018

docker-robott added the lifecycle/stale label Dec 4, 2018

docker-robott removed the lifecycle/stale label Dec 4, 2018

nguyenvietyen mentioned this issue Apr 24, 2019

Nested mounts disappear #3479

Open

2 tasks

docker-robott added the lifecycle/stale label May 1, 2019

docker-robott removed the lifecycle/stale label Jun 21, 2019

docker-robott added the lifecycle/stale label Jan 11, 2020

docker-robott removed the lifecycle/stale label Jan 11, 2020

docker-robott added the lifecycle/stale label Apr 10, 2020

docker-robott removed the lifecycle/stale label Apr 16, 2020

kurko mentioned this issue Jun 16, 2020

File system performance improvements #1592

Open

thaJeztah mentioned this issue Jul 29, 2020

If you touch a submount point on the host the volume is unmounted in the container #3976

Closed

2 tasks

docker-robott added the lifecycle/stale label Sep 14, 2020

docker-robott added lifecycle/frozen and removed lifecycle/stale labels Sep 14, 2020

eason9487 mentioned this issue Feb 29, 2024

Avoid the test-data plugin occasionally missing in the E2E test environment woocommerce/google-listings-and-ads#2286

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Volume get detached after error with osxfs notifications #2777

Volume get detached after error with osxfs notifications #2777

waj commented Apr 6, 2018

rchomat commented Apr 13, 2018

artyfarty commented Apr 24, 2018

artyfarty commented Apr 24, 2018

waj commented Apr 27, 2018

paschdan commented Jun 6, 2018

docker-robott commented Sep 4, 2018

artyfarty commented Sep 4, 2018 •

edited

Loading

paschdan commented Sep 5, 2018

docker-robott commented Dec 4, 2018

artyfarty commented Dec 4, 2018

waj commented Jan 31, 2019

docker-robott commented May 1, 2019

nguyenvietyen commented May 1, 2019 •

edited

Loading

waj commented Jun 21, 2019

waj commented Aug 8, 2019

macrael commented Oct 13, 2019

docker-robott commented Jan 11, 2020

artyfarty commented Jan 11, 2020 •

edited

Loading

docker-robott commented Apr 10, 2020

waj commented Apr 16, 2020

waj commented Apr 16, 2020

kurko commented Jun 16, 2020

docker-robott commented Sep 14, 2020

artyfarty commented Sep 14, 2020

daveisfera commented Sep 14, 2020

Volume get detached after error with osxfs notifications #2777

Volume get detached after error with osxfs notifications #2777

Comments

waj commented Apr 6, 2018

docker-compose.yml:

Dockerfile:

rchomat commented Apr 13, 2018

artyfarty commented Apr 24, 2018

artyfarty commented Apr 24, 2018

waj commented Apr 27, 2018

paschdan commented Jun 6, 2018

docker-robott commented Sep 4, 2018

artyfarty commented Sep 4, 2018 • edited Loading

paschdan commented Sep 5, 2018

docker-robott commented Dec 4, 2018

artyfarty commented Dec 4, 2018

waj commented Jan 31, 2019

docker-robott commented May 1, 2019

nguyenvietyen commented May 1, 2019 • edited Loading

waj commented Jun 21, 2019

waj commented Aug 8, 2019

macrael commented Oct 13, 2019

docker-robott commented Jan 11, 2020

artyfarty commented Jan 11, 2020 • edited Loading

docker-robott commented Apr 10, 2020

waj commented Apr 16, 2020

waj commented Apr 16, 2020

kurko commented Jun 16, 2020

docker-robott commented Sep 14, 2020

artyfarty commented Sep 14, 2020

daveisfera commented Sep 14, 2020

artyfarty commented Sep 4, 2018 •

edited

Loading

nguyenvietyen commented May 1, 2019 •

edited

Loading

artyfarty commented Jan 11, 2020 •

edited

Loading