Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fatbuildrd crash due to archive file not found #179

Closed
rezib opened this issue Jul 2, 2024 · 0 comments · Fixed by #186
Closed

fatbuildrd crash due to archive file not found #179

rezib opened this issue Jul 2, 2024 · 0 comments · Fixed by #186
Assignees
Labels
bug Something isn't working
Milestone

Comments

@rezib
Copy link
Contributor

rezib commented Jul 2, 2024

fatbuildrd[3380183]: worker-devs: [INFO] fatbuildr.builds Running build 57dc36f9-cdaf-49ac-bf56-3cd6ea81a500
fatbuildrd[3380183]: worker-devs: [INFO] fatbuildr.builds Extracting tarball /run/fatbuildr/fatbuildr-artifact-7o91x8i1.tar.xz in destination /var/lib/fatbuildr/workspaces/devs/57dc36f9-cdaf-49ac-bf56>
fatbuildrd[3380183]: worker-devs: [DEBUG] fatbuildr.artifact Loading artifact definitions from /var/lib/fatbuildr/workspaces/devs/57dc36f9-cdaf-49ac-bf56-3cd6ea81a500/artifact.yml
fatbuildrd[3380183]: worker-devs: [INFO] fatbuildr.builds Using provided source archive /var/lib/fatbuildr/workspaces/devs/57dc36f9-cdaf-49ac-bf56-3cd6ea81a500/slurm-web-3.1.0a2.dev1.tar.xz
fatbuildrd[3380183]: Exception in thread worker-devs:
fatbuildrd[3380183]: Traceback (most recent call last):
fatbuildrd[3380183]:   File "/usr/lib/python3.11/shutil.py", line 825, in move
fatbuildrd[3380183]:     os.rename(src, real_dst)
fatbuildrd[3380183]: OSError: [Errno 18] Invalid cross-device link: '/run/fatbuildr/slurm-web-3.1.0a2.dev1.tar.xz' -> '/var/lib/fatbuildr/workspaces/devs/57dc36f9-cdaf-49ac-bf56-3cd6ea81a500/slurm-web>
fatbuildrd[3380183]: During handling of the above exception, another exception occurred:
fatbuildrd[3380183]: Traceback (most recent call last):
fatbuildrd[3380183]:   File "/usr/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
fatbuildrd[3380183]:     self.run()
fatbuildrd[3380183]:   File "/usr/lib/python3.11/threading.py", line 975, in run
fatbuildrd[3380183]:     self._target(*self._args, **self._kwargs)
fatbuildrd[3380183]:   File "/usr/lib/python3/dist-packages/fatbuildr/cli/fatbuildrd.py", line 133, in _worker
fatbuildrd[3380183]:     instance.tasks_mgr.run(task)
fatbuildrd[3380183]:   File "/usr/lib/python3/dist-packages/fatbuildr/tasks/manager.py", line 208, in run
fatbuildrd[3380183]:     task.run()
fatbuildrd[3380183]:   File "/usr/lib/python3/dist-packages/fatbuildr/builds/__init__.py", line 235, in run
fatbuildrd[3380183]:     self.prepare()
fatbuildrd[3380183]:   File "/usr/lib/python3/dist-packages/fatbuildr/builds/__init__.py", line 282, in prepare
fatbuildrd[3380183]:     shutil.move(source.path, source_archive_target)
fatbuildrd[3380183]:   File "/usr/lib/python3.11/shutil.py", line 845, in move
fatbuildrd[3380183]:     copy_function(src, real_dst)
fatbuildrd[3380183]:   File "/usr/lib/python3.11/shutil.py", line 436, in copy2
fatbuildrd[3380183]:     copyfile(src, dst, follow_symlinks=follow_symlinks)
fatbuildrd[3380183]:   File "/usr/lib/python3.11/shutil.py", line 256, in copyfile
fatbuildrd[3380183]:     with open(src, 'rb') as fsrc:
fatbuildrd[3380183]:          ^^^^^^^^^^^^^^^
fatbuildrd[3380183]: FileNotFoundError: [Errno 2] No such file or directory: '/run/fatbuildr/slurm-web-3.1.0a2.dev1.tar.xz'
fatbuildrd[3380183]: worker-pkgs: [DEBUG] fatbuildr.tasks.manager Trying to get task for up to 60 seconds
fatbuildrd[3380183]: timer: [WARNING] fatbuildr.cli.fatbuildrd Detected dead worker-devs thread, notifying service manager
fatbuildrd[3380183]: timer: [DEBUG] fatbuildr.services Set new service status: Worker thread worker-devs failed
fatbuildrd[3380183]: timer: [DEBUG] fatbuildr.services Notifying service manager for error
fatbuildrd[3380183]: timer: [DEBUG] fatbuildr.timer Waiting for timer lock for 10.000000 seconds
systemd[1]: fatbuildrd.service: Watchdog request (last status: Worker thread worker-devs failed)!
systemd[1]: fatbuildrd.service: Killing process 3380183 (fatbuildrd) with signal SIGABRT.
systemd[1]: fatbuildrd.service: Killing process 3415478 (gpg-agent) with signal SIGABRT.
systemd[1]: fatbuildrd.service: Main process exited, code=killed, status=6/ABRT
systemd[1]: fatbuildrd.service: Failed with result 'watchdog'.
@rezib rezib added the bug Something isn't working label Jul 2, 2024
@rezib rezib added this to the v2.1.0 milestone Jul 2, 2024
rezib added a commit that referenced this issue Jul 12, 2024
This commit makes fatbuildrctl (when working on DBus) and fatbuildrweb
drop off artifact and sources archives tarballs in subdirectory of
fatbuildr runtime directory in order to avoid potential collisions
between multiple builds in fatbuildrd queue

Then fatbuildrd pick up the files and remove temporary subdirectory when
processing the build.

fix #179
@rezib rezib self-assigned this Jul 15, 2024
@rezib rezib closed this as completed in 4c5c430 Jul 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant