Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enable CRB and EPEL if we are running with the EPEL profile #41

Closed
wants to merge 5 commits into from
Closed

Enable CRB and EPEL if we are running with the EPEL profile #41

wants to merge 5 commits into from

Conversation

msrb
Copy link
Member

@msrb msrb commented Sep 20, 2024

Fixes: OSCI-6783

msrb added 3 commits September 20, 2024 11:47
@msrb
Enable CRB and EPEL if we are running with the EPEL profile
863381d 
Fixes: OSCI-6783

Signed-off-by: Michal Srb <michal@redhat.com>
@msrb
Enable debug output in the prepare script
a1092a3 
Signed-off-by: Michal Srb <michal@redhat.com>
@msrb
Fix profile name
b446890 
Signed-off-by: Michal Srb <michal@redhat.com>
@msrb
Copy link
Member Author

msrb commented Sep 20, 2024 •
edited
Loading

It seems like both CRB and EPEL are actually already enabled:

https://artifacts.dev.testing-farm.io/7d43c63c-ac23-454d-9c43-8382d9fdf002/

+ [[ centos-stream-9 == centos-stream-* ]]
+ echo 'Enabling CRB and EPEL...'
Enabling CRB and EPEL...
+ yum config-manager --enable crb
+ yum -y install epel-release
CentOS Stream 9 - BaseOS                         59 kB/s | 2.3 kB     00:00    
CentOS Stream 9 - BaseOS - Debug                114 kB/s | 1.5 kB     00:00    
CentOS Stream 9 - BaseOS - Source               108 kB/s | 1.5 kB     00:00    
CentOS Stream 9 - AppStream                     206 kB/s | 2.8 kB     00:00    
CentOS Stream 9 - AppStream - Debug             120 kB/s | 1.5 kB     00:00    
CentOS Stream 9 - AppStream - Source             97 kB/s | 1.5 kB     00:00    
CentOS Stream 9 - CRB                           205 kB/s | 2.7 kB     00:00    
CentOS Stream 9 - CRB - Debug                   127 kB/s | 1.5 kB     00:00    
CentOS Stream 9 - CRB - Source                  105 kB/s | 1.5 kB     00:00    
CentOS Stream 9 - HighAvailability              176 kB/s | 2.3 kB     00:00    
CentOS Stream 9 - HighAvailability - Debug      110 kB/s | 1.5 kB     00:00    
CentOS Stream 9 - HighAvailability - Source     107 kB/s | 1.5 kB     00:00    
CentOS Stream 9 - NFV                           162 kB/s | 2.3 kB     00:00    
CentOS Stream 9 - NFV - Debug                   116 kB/s | 1.5 kB     00:00    
CentOS Stream 9 - NFV - Source                  107 kB/s | 1.5 kB     00:00    
CentOS Stream 9 - RT                            211 kB/s | 2.3 kB     00:00    
CentOS Stream 9 - RT - Debug                    103 kB/s | 1.5 kB     00:00    
CentOS Stream 9 - RT - Source                   106 kB/s | 1.5 kB     00:00    
CentOS Stream 9 - ResilientStorage              154 kB/s | 2.3 kB     00:00    
CentOS Stream 9 - ResilientStorage - Debug      122 kB/s | 1.5 kB     00:00    
CentOS Stream 9 - ResilientStorage - Source     115 kB/s | 1.5 kB     00:00    
CentOS Stream 9 - SAP                            70 kB/s | 2.3 kB     00:00    
CentOS Stream 9 - SAP - Debug                   101 kB/s | 1.5 kB     00:00    
CentOS Stream 9 - SAP - Source                  102 kB/s | 1.5 kB     00:00    
CentOS Stream 9 - SAPHANA                       163 kB/s | 2.3 kB     00:00    
CentOS Stream 9 - SAPHANA - Debug               110 kB/s | 1.5 kB     00:00    
CentOS Stream 9 - SAPHANA - Source              128 kB/s | 1.5 kB     00:00    
CentOS Stream 9 Buildroot                       3.1 kB/s | 3.8 kB     00:01    
Package epel-release-9-7.el9.noarch is already installed.
Dependencies resolved.
Nothing to do.
Complete!

@msrb msrb mentioned this pull request Sep 20, 2024
Closed
@psss
Copy link

psss commented Sep 20, 2024

Hm, interesting. For reference, here's a recent pull request and Testing Farm job which failed:

@msrb
Copy link
Member Author

msrb commented Sep 20, 2024

Yeah, and this test pipeline failed as well :) Maybe there are actually some dependency problems (?)

@psss
Copy link

psss commented Sep 20, 2024

The installability job complains about missing python3.9dist(typing-extensions), but they are in epel9:

# dnf install -y 'python3.9dist(typing-extensions) >= 4.9'
Extra Packages for Enterprise Linux 9 - x86_64                 11 MB/s |  23 MB     00:02    
Extra Packages for Enterprise Linux 9 openh264 (From Cisco) - 7.6 kB/s | 2.5 kB     00:00    
Extra Packages for Enterprise Linux 9 - Next - x86_64         995 kB/s | 276 kB     00:00    
Dependencies resolved.
==============================================================================================
 Package                            Architecture    Version               Repository     Size
==============================================================================================
Installing:
 python3-typing-extensions          noarch          4.12.2-2.el9          epel           74 k

Transaction Summary
==============================================================================================
Install  1 Package

@msrb
Copy link
Member Author

msrb commented Sep 20, 2024 •
edited
Loading

Could this be TF adding/enabling the EPEL repository automatically? And possibly using some older version/compose or something (?)

@msrb
Copy link
Member Author

msrb commented Sep 20, 2024

Ah, I think I understand now. I think epel-release is pre-installed by TF, but the repo is actually disabled...

Let's see...

@msrb
Enable EPEL repo
a8f8e1f 
Signed-off-by: Michal Srb <michal@redhat.com>
@msrb
Copy link
Member Author

msrb commented Sep 20, 2024

Meh...

Package epel-release-9-7.el9.noarch is already installed.
Dependencies resolved.
Nothing to do.
Complete!
+ yum config-manager --enable epel
Error: No matching repo to modify: epel.

So something is installing epel-release, but then probably monkey-patching the system and modifying the repos 🤔

@msrb
Reinstall epel-release
945bfdd 
Signed-off-by: Michal Srb <michal@redhat.com>
@psss
Copy link

psss commented Sep 20, 2024

@thrix, @happz, is Testing Farm possibly doing any changes to the epel repo files?

@thrix
Copy link
Contributor

thrix commented Sep 24, 2024

I am looking at this

@thrix
Copy link
Contributor

thrix commented Sep 24, 2024

@msrb not really, it should be installed and enabled (we do not disable it as in RHEL)

@martinhoyer
Copy link

Using the reproducer from https://artifacts.dev.testing-farm.io/7d43c63c-ac23-454d-9c43-8382d9fdf002/ the epel and crb repos are present, but not enabled.
dnf install tmt --enablerepo=epel --enablerepo=crb works as expected.

@thrix
Copy link
Contributor

thrix commented Sep 24, 2024 •
edited
Loading

@martinhoyer that should not be the case for Testing Farm itself:

$  testing-farm-public reserve --compose CentOS-Stream-9
...
[root@ip-172-31-19-254 ~]# dnf repolist
repo id                                                                                                              repo name
appstream                                                                                                            CentOS Stream 9 - AppStream
baseos                                                                                                               CentOS Stream 9 - BaseOS
copr:copr.fedorainfracloud.org:packit:beakerlib-beakerlib-master                                                     Copr repo for beakerlib-beakerlib-master owned by packit
crb                                                                                                                  CentOS Stream 9 - CRB
epel                                                                                                                 Extra Packages for Enterprise Linux 9 - x86_64
epel-cisco-openh264                                                                                                  Extra Packages for Enterprise Linux 9 openh264 (From Cisco) - x86_64
epel-next                                                                                                            Extra Packages for Enterprise Linux 9 - Next - x86_64
extras-common                                                                                                        CentOS Stream 9 - Extras packages
testing-farm-tag-repository

As you can see, epel, epel-next and crb repositories are there and enabled

@thrix
Copy link
Contributor

thrix commented Sep 24, 2024

@msrb I do not see a problem with Testing Farm, has to be installability, most probably mtps-prepare-system

@psss
Copy link

psss commented Oct 2, 2024

Here's a fresh instance of the problem:

@msrb, are you familiar with mtps-prepare-system? Who does currently take care of it?

@thrix
Copy link
Contributor

thrix commented Oct 29, 2024

@msrb FTR, this is the state after TF hands over the execution to tmt:

❯ testing-farm reserve --compose CentOS-Stream-9
💻 CentOS-Stream-9 on x86_64 
🕗 Reserved for 30 minutes
⏳ Maximum reservation time is 720 minutes
🔎 https://api.dev.testing-farm.io/v0.1/requests/c7726e59-f761-43e9-b0cf-bd42a7dccfca
🔑 Adding SSH proxy key
Identity added: (stdin) (proxy@ip-172-31-22-4.us-east-2.compute.internal)
🌎 ssh -J proxy@testing-farm.io root@18.222.215.129
Welcome to Testing Farm!

Machine is reserved for 30 minutes.

To extend the reservation, run 'extend-reservation MINUTES'.

To return machine back, run 'return2testingfarm'.

To reboot the machine, use 'tmt-reboot'.
Last login: Tue Oct 29 10:43:06 2024 from 18.191.202.183


[root@ip-172-31-28-98 ~]# rpm -q epel-release
epel-release-9-7.el9.noarch

[root@ip-172-31-28-98 ~]# dnf makecache
Tag repository for c9s-build                                                                                                                                                                                  22 MB/s |  14 MB     00:00    
Copr repo for beakerlib-beakerlib-master owned by packit                                                                                                                                                      35 kB/s | 1.8 kB     00:00    
CentOS Stream 9 - BaseOS                                                                                                                                                                                      35 kB/s | 5.0 kB     00:00    
CentOS Stream 9 - AppStream                                                                                                                                                                                   47 kB/s | 5.0 kB     00:00    
CentOS Stream 9 - CRB                                                                                                                                                                                         46 kB/s | 5.2 kB     00:00    
CentOS Stream 9 - Extras packages                                                                                                                                                                             73 kB/s | 6.9 kB     00:00    
Extra Packages for Enterprise Linux 9 - x86_64                                                                                                                                                               230 kB/s |  27 kB     00:00    
Extra Packages for Enterprise Linux 9 openh264 (From Cisco) - x86_64                                                                                                                                         5.7 kB/s | 993  B     00:00    
Extra Packages for Enterprise Linux 9 - Next - x86_64                                                                                                                                                        125 kB/s |  25 kB     00:00    
Metadata cache created.

As you can see, epel is enabled on the machines.

@psss
Copy link

psss commented Dec 4, 2024

Another instance of a failed job:

@msrb, do you see anything wrong on the Testing Farm side from the output @thrix provided above?

@msrb
Copy link
Member Author

msrb commented Dec 5, 2024

@psss Nope, this is definitely mini-tps/pipeline issue.

@psss psss requested a review from jpopelka December 6, 2024 11:26
@msrb msrb closed this Dec 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jpopelka jpopelka Awaiting requested review from jpopelka

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@msrb @psss @thrix @martinhoyer